Collect those gems. They are the real source of those higher scores.