Go into High Time (warproom 3) and about two-thirds of the way through there is a little platform at the base of a wall. Jump on the platform and it will take you to a secret level where you will get the purple gem.