When I go there, I can only choose to summon ghosts or leave.
i was stuck here for a long time. You have to progress the storyline quite a bit. For now, i highly recommend you focus on relationships. I think everyone but Nel was at 100% by the time it opened up. One of Nel's final scenes i think is what opened it up. Just keep talking to the fortune teller to progress.