This is really frustrating in the moment, but there's actually a reason why this happens. If you've finished Flynn's route you've probably figured it out yourself by now
