Nice idea! I like the mechanic.
If everything was a bit slower ... so more mass, less gravity etc I would feel more in control.
The other thing that I noticed is the X mouse position didn't seem linear enough so it felt unpredicatble for my left-right movement.