When you climb a ladder, you will automatically put away your weapon. Press B to take it out while still on the ladder.