You can find worms in three small grassy spots in a small alcove of trees just southeast of the waterfall.