Thanks very much for the detailed feedback! Sorry for the delay, I don't check itch.io too often.
Have you tried rebinding Undo to another key? (from the Controls menu) If the issue is pressing it out of habit then that could help.
No editing objects at the moment though I'm hoping to add it, I agree that would probably warrant rethinking a few controls.