I had issues where I kept getting stuck in places where I could not move.
Try restarting the level.
I think, the longer you wait as idle, the longer it will wait when your in the process of rewinding.
