Just keep doing that you'll find an entrance eventually( but you need to take a task of the day witch for your character to start looking for a way in)
You have to have really low Lust. There's a protective spell around it to keep the horny warriors from getting too close to the acolytes. It works on you, too.