You might want to just face another direction to do an action without actually moving (into a laser beam or a crumbling floor tile for instance), so it is needed. You might like the mouse control more, though you have to be careful. A mix of both does work.
The undo key does undo block pushes but also any other move for the same reason (it also works if you're accidentally hit by a laser beam and die).