there are 3 badges, they give different rewards via the ferryman in the cave and they let you find Bread in there (jester aside) (also different bevocr value at the pawn shop, i guess).
About the fight tho, the king can have halved HP with the knight badge or skip the fight and give you a +1 CHA equipment instead of the blade piece. See the guide if you wanna know the ferryman rewards