I was confused about what to do at first but once I got the hang of it it was easy. The challenge was to make the association from face to arrow key. Enough content for a jam game, congrats on the first jam!
It is one of the most important things I learned during this game jam: being clear with the player about what he/she is supposed to do! I had the same feeling with few games I tried.