This is great! This is the kind of out of the box thinking that makes VR so much fun. Kokutouchichi mentioned you should consider running with this, polishing it and releasing it. The idea is solid through and through. You may want to consider changing what you allow the main camera to render. I ended up having my vision blocked a few times because it was rendering the body.
This is a great concept overall! Congrats on a unique and great idea!