You can upgrade a building multiple times and the second, third, fourth, and so on will be free.