I love the idea, though i think this would work much better if you would have to match the exact number on the enemy to defeat them, cuz right now you can just brute force your way through in case the enemies are getting too close
You could rig the randomness, so that the right dances are way more likely, and give the player freedom to launch whichever dice they want (like right now you have to use the one in your right hand), maybe even do the choosing of the dice using number keys