It was a bit difficult at first, but after a few tries it ended up being the "there's no way I can't do better next time" difficult rather than the "this is too frustrating" difficult, which is always a good thing.
It's a concept that can be polished and expanded and if you decide to do that one of the things I would do first would be to have a better onboarding: presenting the concepts gradually + lowering the difficulty a bit at first and ramping it up after.
The concept is fun and I think you'll get many more people playing it if the barrier to entry isn't that high.
Good luck!