That part could be made clearer in-game.
And you can't say it's optional, you know perfectionists out there will chase all the sixes. That's how the world works.
As an alternative, you could have freed characters give stat-resources dependent on their overall stats, which can be used to improve existing characters. Mansion upgrades could be used to improve resource gains.