Do what turnimp told you. I don't know if you have to find Jester first (I think you meet him by sneaking in), but once you did the fight against the two, you'll be able to roam freely
