Just accidentely "solved" my problem. I didn't see the exit button in the prison hallway needed to go to the warden's office.
