Oh that just means you can't advance your relationship with the character you're trying to raise affection with, until you reached a certain event in the story, and unlock their special scenes, you can still proceed with the game but won't raise your standing with them is all.