If you play on Hard, no. Its an incentive only keep characters with good stats. Most subordinate found at the guilds will have decent stats except for growth if you upgrade the guilds. Some unique characters get a one point incease to a factor if you follow their questline