To reach the island, and the final puzzle, you need to get fifty of every color of gem. You can cheese this by crossing out every square in the puzzle, picking up the gems as you go, then completing it normally. There aren't anywhere near fifty gems in each of the three stages per color, so you'll have to replay stages you've already beaten.