The Custom Groove option appears once a normal Boss has been defeated (normal Akuma or Rugal). Normal Bosses appear by fulfilling two of the four following conditions.

Achieve over 1000 GPS by the end of the game.
Achieve four or more special KOs.
Middle Boss has appeared.
Achieve two or more LV3 super combo KOs.