The incredibly abstract art had me a little puzzled at first as to what I had to do (pushing squares on other squares?). I feel like a *tad* more detail on the objects would help a bit in that regard, giving more meaning to your actions. Though with that said, the little tutorial levels at the start are also great at explaining the mechanics.
This reminded me a bit of some puzzles in Baba Is You. That had me automatically pressing Backspace to try to reverse a wrong move, a very useful option in that game; I think that would be great here too (albeit perhaps quite some work) to implement, as restarting an entire level over a single misstep sometimes felt quite harsh. Another thing that I appreciate in Baba Is You is the ability to skip a difficult level and just come back to it later; from the map, you always have access to multiple levels, you don't need to solve them all or do them in a precisely linear fashion. Not that you have to copy that game, but I found those mechanics work very well to balance out the difficulty.
The concept is cool and the puzzles are clever, but I also have to agree on difficulty ramping up too fast.