Really cool idea!
I think some of the quaternion math for the knobs kicked your butt (I understand, I have been there before). I will also say, that providing visual indicators of the knob's affordances and current value would enhance the experience as well (but this is another quaternion math problem, lol). A good example would be gain knobs found on a lot of audio equipment (picture below).
I think this was a really novel idea for a jam, though, and a solid attempt; good work!