So the only hardware that I have to test locally are Quest 2 and 3. I know if you use Oculus Link/AirLink, the game works as intended. People that have reported the same bugs on Quest are usually connecting to their PC using other means. Give that a try if so.
In the future I do plan to make the game more compatible for those who don't wish to use the Oculus software to connect to a PC, but for now, this is the easiest way for me develop the game.