Cool concept. Impressive tech.
I was trying to draw by holding left and right, then releasing right to draw the door knob. It seems counter intuitive that you release left and hold right, since left raises the finger. Like left is select tool and right is use tool, when in reality it's the other way around.
Also, you could display a cubemap of the room on the portal at a distance to give the impression that it doesn't stop rendering.