Maybe you're wearing the purple slime girl. Remove her first and do it again.
I actually needed to progress the story a lot. It got unlocked by meeting her in the mascarade party for the first time. That was quite confusing though, I don't think the Fortune teller should keep telling me to do something that doesn't work.
She only give hint . You have to find out
