I noticed this too, so I checked the FAQ on Tumblr and turns out that in this game the bar doesn't indicate the affection of the NPC towards the player: it only represents their demeanor/attitude towards the player.
Ah ok ty XD