Press [Alt] + X as your opponents attack. Your party will still gain the experience points and treasure from the battle.