This is nice concept and a pretty good proof of concept. As you said, it still needs a lot of working, but it has pretty good potential. What you have runs pretty well and looks nice, no strange looking UI or any obvious bugs to speak of. AsE_CG's comment summed up my thoughts on this pretty well. I also played the web version and had no issues. You could take this idea a bunch of different ways, so I'm curious to see which you choose. May have to visit this project at a later date.