go to the hut on fridays after he invites you. I don't specifically know when he does but just do everything you can for him until nothing else shows up and he starts talking about the hut and fridays after you are leaving. I believe he's there at like 20:00, later than that or a little earlier.