This is pretty cool! I like the concept a lot. The collision detection feels rather off, making is very difficult to actually hit the die. I think the idea of trying to avoid collateral damage is really neat though!
p.s. - I also made a game called Just Roll With It, lol