You can unlock various goats by acquiring the corresponding number of trophies, as indicated below.

Trophy	How to unlock
Feather Goat	Can jump higher than others (10 or 15)
Giant Goat	Can blow water (20 or 25)
Space Goat	No apparent benefits (30)
Tall Goat	Taller than everyone else (5)