Perhaps there can be cursed clothing or outfits that give special perks but can't be removable and limit actions until quest lines associated with that clothing are completed.
There is something like that on the planned features list, but if it happens, it will require some other things to be in place first. Perhaps in the future
