If you're talking about the key in the first town, you can bring it to the guard in the town hall of that town. The key you get from Sword after the small scene doesn't do anything yet.
Awesome, thank you!
what guard?
