Thanks for playing!
I haven't experienced that. The teleporting, and connecting are not tied in anyway. Could it possibly be that your input/tracking stopped working? Seeing that one controller is for connecting, the other is teleporting and both were somewhat unresponsive.
If I go to room 3 and connect and unconnect a bunch of items, also select and deselect by selecting the object again. Eventually 15-20 seconds the connector stops working. I recorded a video after it broke. https://we.tl/t-OyHynikLwt