There is no key, you have to be accompanied by someone to enter
Try talking to the NPC outside the gate while Rinny (the succubus girl) is with you.
(If you need any other help with her arc you should check out the walkthrough https://www.youtube.com/watch?v=mVuzuJeoPBI&t=18s)