I believe that this idea has some great potential. It would need different mechanics to make it into a great puzzle game but this is a strong start already. great job!
and lastly thank you for the option to skip the dialogue as it can be overlooked on most games.