When you are looking for a cave, look in the mountains, but while in the mountains look for a bear. Once you find it look around the area it's in and you should have a cave.