It's a cool idea and it seems like there's some clever stuff going on in the background, a bit of audio and visual feedback of what's happening would go a long way for playability and immersion.
I agree with you, but I'll probably not update it after the jam. Obvious reason: no one is going to play it.