Really like the idea.
I just feel that you need some solution when the player gets trapped because he misses the controls to regain control.