I like the concept a lot, it's clever. The controls in general could be a bit better but they get the job done!
I think it has potential and you should keep at it. One easy improvement would be to use the graphics you have in the screenshot. I think those are cute!