To get additional Poké Balls, you must get a “CAVE” bonus. Thereafter, every 20th time the letters are lit, you will receive an additional ball!