No worries, you thought outside of the box so well done ^^
Only advise I can give you, and it is a purely for Game Jams, since entries are normally mainly Judged/rated in the first 5-10 minutes of play, it is best to make the presentation clear on the get go.
100%. Very much a failure of the game to convey that information. I really appreciate that kind of feedback because it helps crystallize the areas I need to improve in!