Have you finished her route? That's all that's needed to go on a date with her!
blep I forgot to turn on the specific shrine... date done and all is well.