The only limit to using magic is their long cooldowns. Cast magic abilities as soon as they are needed in order to get the cooldown started for their next use.