You need affection to unlock/complete some quests. Off the top of my head, there's the girl in the bookstore and the bear in the love hotel.
Awesome, thanks