You probably didn't have enough affection points with them at that point, download the walkthrough to see what you got wrong!
