Buildings and defenses that can be upgraded will have a small green arrow below them. You must be at a certain level and have the correct resources to complete a certain upgrade. You can only have one construction or building upgrade in progress at once, unless you spend 750 gold for an additional engineer.