When you can access the second and third floor of the Deep Dungeon side quest you will notice that you can fight Ninjas. Make sure everyone is equipped with the catch ability and kill all the ninjas but the male one. He will eventually throw Excaliburs and even a Chaos blade at you to add to your inventory. Just kill him and do the battle over again to obtain more of these powerful weapons.