If you have a spot in your town reserved for something special, but don't want villagers moving there, put some custom design boards in the area. Villagers can't move their houses where public works are so if you do that, it will be clear of any houses.