I don't remember him asking, there was talk of being tired and needing to visit the inn, so I went over and had the coffee interaction. Can we open a conversation and ask again?
Ah, if you declined, you've missed your chance. You'll have to go back to a previous save and ask him again.
