I love the aesthetics!
It took me a little while to figure out that the keys were hidden in the dice and, as others have said, the controls were a little difficult. Other than that, I really enjoyed the game, good job!
Your game is very good for a first game jam!
I don't think you have to make it easy, you only have to balance the difficulty. I saw in another comment that you said the more you play, the easier it gets. I think it should be the opposite: easy to play but hard to master.
It's always a certain risk to offer a difficult game in this gamejam, because most people won't play your game for more than 5-10 minutes.
At the end of the day, I think everyone's goal is to create a fun game. Gamejams are there to test new concepts. Sometimes they work, sometimes they don't and that's okay! That's part of the fun :)
Next time, don't create "an easy game" because that's what works, create the game you want but make sure the first 4-5 levels are accessible, and gradually increase the challenge.