A party can only have one banner, correct?
I feel like mixing and matching is funny but also a thing for late game.
It also gives some special bonuses to new party members gained after a new player joins or after the death of an existing party member if playing in campaing form.
Also the idea of sneaky guys in heavy plate armor is funny.