I had a very similar experience and nearly gave up trying to figure it out. Thankfully it clicked eventually, and I had some fun with it overall. I think this game has a great central idea/mechanic for the puzzles, and with a little more polish could be really special!