You should notice a spiral tower with a fence surrounding its base, not far from where you spawn. Climb those stairs to the top floor to arrive in a throne room. You can stand on the throne to be acknowledged as the Goat King. As the king, you wear a skull mask and you can press the Action button to produce goats whenever you like.