This typically happens when the relationship levels have been manually adjusted by the player. So I would recommend playing a save from before that was changed.