That can happen if you click or use the arrow keys while on the mirror screen! your character walks away from the mirror when that happens, and you can only exit the mirror scene by clicking the same place you entered it from.