Really unique game mechanic ! I has a lot of potential.
As a I see it's your first jam right ?
My advice for future ones would be to make these kind of games level based and thus with an ending. It gets usually the player more invested in your game.