I got a lot of chuckles out of this! Nice work. Baby made me feel bad about losing lol.
Main suggestion is separating the locomotion from grabbing. I kept accidentally teleporting when trying to snag cubes and then I'd keep teleporting because I had the grip held down.