As you pass through the shapes, you're in trouble if you brush against a wall with a color that doesn't match your own. Definitely aim to pass through the appropriate walls, but an even better option is not zipping through a wall at all. Sometimes, you can grab a star and get free of the area without touching anything else, and that's just fine.