Cool concept that I think has some potential for storytelling in terms of the minimalist presentation. I think one thing that would've been cool for the jam build specifically is a timer; then people could've compared best times with each other.
Interesting idea, adds more goals, and interaction between players. Thanks for the feedback!