Cool concept! I love the "doll house" scale. Great job!
You mention the Quest version having issues, but it worked fine for me on the Quest 3.