(Have you unlocked the 1st and 2nd scenes of Yui's gallery?) try to change the time first and then go to his house, some missions will not start if you change the time there.
