If there are xp orbs that you can't reach, (for example: if it's across a stream) you can use your bow to shoot the orb and you'll get the xp.