The second weapons for Rusty, Mary, and Abbey can be carried over to subsequent new games once the following conditions are met:

Clear the game on any difficulty to unlock Vampire Side.
Clear Vampire Side.
Clear ISLA Side on Normal difficulty.