Thanks for playing, yep it was fun playing with the Godot's physics settings to see how good I could get it, it was way worse before I got into the advanced settings, I started working on getting some sort of freezing on blocks out of view, I just ran out of time getting it to then return the blocks to the physics solver at the right time.
Of course I'll play your game, I make a rule of trying out every game from anyone who comments :)