how to show proof to that cloak guy in the cave

It's the badges you can find further into the cave

Knight Badge is the most important one, keep it! Prince Badge is the least important.

Show him the Jester badge! It’ll let you take the ferry