Sometimes the little character does not respond to the swinging motion of your hand. To make him swing almost every time, do a back swing as you would do in tennis.