Really cool concept! It obviously misses some content, but the idea is good and you could easily build on that.
The walking should be smoothed a little bit, with an animation or something. Currently the "jumping" from one state to another can quickly give a headache.
Visuals are cool!
Let me know if you continue this project, I would like to see more of it!