If you've built an Elite Boutique, this has probably happened to you. If you don't give the Elite Boutique any business, as in you don't buy anything for a few days, the shop keeper will leave and he/she will not come back. At that point, you'll have to remove the Elite Boutique.