You have to get him to share the bed with you during your weekly hunting trips (I hope you're doing those with him).That gets you the first heart, then you'll have additional interactions available to get more.
How do I start the hunting trips? He mentioned it, but I don't know to initiate it.
EDIT: I figured it out.
