That's part of the story. Just keep spending time with him some more (in all the locations he frequents to!)
