I think you can gain some more like from him by let him visit your hut (random during a day, once a week) and do some interactions with him.
