its not unplayable, make an axe by getting a stick and a stone then left click on the log to make 2 planks. Very inefficient but is required to start. And removing buildings and blueprints works perfectly fine for me.
you can only RMB and del in edit mode
