When you die, you will lose a portion of your weapon upgrades. To prevent this from happening, simply choose to return to the "Title Screen" instead of retrying after you die. Then, choose to "Continue" your game from the title screen to keep all your weapon upgrades.