I advice finishing the main story first then go do all the side quests
i did tho
Try going in the afternoon every week Days if it doesn't work then I don't know
Make sure you have defeated the shrine maiden