You do not need to move your whole body. Just move the hand that has the Wiimote.