When you do not want to be hit by ghosts and lose all your items (Balloons, Beans, and sometimes Stink Pellets) just stand on the ledge until the specter nears you. Tap the controller so that you will fall and catch the ledge. When you are hanging, they cannot hit you and cause your items to go flying.