You do not have to fight all enemies. You can run past them, or you could get across pits with enemies by jumping in the pit, running to the other side, and jumping out.