If everyone except imposters had a "DUMMY/DUNCE" hat on, that would make it easy to tell imposters from crewmates. That last idea for the role is kinda bad and would break the game.
maybe only the people who voted for the jester have that hat, so it wouldnt out the imposters while still a [jokey] punishment for voting out the jester