Maybe the *scruff* look was a cultural thing in his homeland or maybe given what we know of the MC is that he's his own thinker and is willing to go against the cultural norms if he did not agree with them or he found them to be repulsive to his morals and likes the low life look because it pisses off the *nobles* back home and that if you play the good MC he's not a raging asshole like most *nobles*