Watch your villagers' experience and level them up when possible. This will allow them to equip new weapon and make them more powerful and useful in battle. Also make sure to upgrade your workshop when possible.