Thanks for the feedback!
Yes I agree, that is the huge flaw, especially in a jam game I think most ppl (myself included) would just assume that it was unfinished and that that was all there was to it. It was actually even more obscure just before I submitted, I made some last minute changes to try to make it clearer. First time trying a puzzle-type game, so I learnt a lot making this :)