I know that extra peripherals are costly, but it could work pretty well with one of those hand tracking VR controllers! Or even a Leap Motion?
oh! that would be so cool, I've never thought about it, maybe even with some custom hardware like some gloves with some kind of sensors it should work and it's way cheaper, I'll look into it, it could be a really interesting side-project :)
