Cool idea! My brain hurts now!
With some streamlining and simplification, this could certainly work as a full app/game! Good job!