The second hero upgrade tier is done through awakening them. This is done by spending rare materials and marks to permanently increase a hero's stats. Awaken your most used heroes as soon as you can. When a new hero is obtained, you can use experience books to upgrade them to get them to the same level as your existing heroes.