I just tested it out on my Oculus Quest 2, works just fine but I somehow managed to get through the first doors (maybe a missing collider?) and then I fell off the world. Or maybe is that intentional? Very excited for your concept!
It seems there was issue with collisions.. It shouldn't be intentional.. We Could make update, but it wouldn't be fair for now..