Clever idea, but as others mentioned, just needs a lot of polish. With that, I would definitely play it more :)
Also, as you mentioned somewhere in your comments, player being able to choose what is used on what dice would be much much better in my opinion.