At the start of the jam we had exactly this idea, then we changed during brainstorming, but i still loved the concept. Seeing it done with this style is indeed lovley, amazing job!!
I just played your game, your game was a great idea as well!