Alligators can be found in the rivers of the Bayou area (south of map). Just jump in the water and swim around until an alligator kills you to get the "Next Time Swim Faster" achievement.