Try to removing magicians is your first concern as their bolts will eliminate your followers with one hit.