Upon killing the boss in each set of stages you are awarded a scroll. Take that scroll to the weapon shop to unlock 5 additional weapons.