I like the concept, but as most others are saying I also ran into a few issues.
I wouldn't mind seeing this finished with a few of the bugs rooted out. I'm sure your next jam entry will be a blast!