Upgrade your Town Hall frequently. Each upgrade will increase overall construction speed, allowing your other buildings to upgrade faster. The level of your Town Hall limits other structures to be at the same level.