This is a super creative idea and really ambitious for a game jam. I would love to see this in a full game form with fleshed out characters and a cool storyline. Really well done!
It ended up being a way bigger project than I had anticipated! It's only a fraction of what I had planned, so maybe you'll get to see that full game sometime in the next 20 years :P
