You must head to the temple located at the top of the map at the required times listed in the girl's menu to access the "challenges."
