Your idea is very cool and original but I think it requires some tuning.
In my opinion the biggest dealbreaker is switching layers because is a little frustrating sinche they are in a certain order. I'd prefer to have a single button for each layer so I can decide which one is active and do it faster.
Visually is a little grainy and the UI is also reaaally big and invasive (but that's an easy fix).
I also kinda struggled with the inputs because I'm left handed (but that's my problem, ahahaha)
I think that polishing art and UI will be a great upgrade! Keep developing this, it is really original!