To dive into the water (rather than just jumping and flailing around), you need to press jump once to leap off wherever you are standing, then press it again in midair. This will execute a flawless dive.

If you are wondering how to dive underwater, simply look down and move in that direction. The water has to be deep enough for you to be able to go underwater.