The more damage you take, the more scarred your face becomes. Even if you eat food or use the potions. After you beat Jack of Blades, take a close look at your face. You will notice that it is probably going to be scared.