I like the idea! It's quite clever, and generate nice puzzle situations.
I may not have seen though how ennemis are supposed to be problematic for the player. I've been able to go around them without too much trouble. However the concept itself is still solid.
And good work on the aesthetic! Love the isometric view and voxels, and the little animations really make the game look super neat.