If you're planning on working on it further, I would definitely lean into the physical VR controls more because that's really good! :-)
That explains why the turrets didn't appear to do anything :D