How to Fill Nail Holes Want to get rid of the holes caused by nails on the wall? Here’s an easy solution: All you have to do is get a bar of white soap and scrub across the hole until it’s filled. This is a great tip for when you’re moving out of a house and want the holes to be gone!