Interesting idea! I think with the right level design this would be a really fun idea but at the moment it is a little frustrating. Another alternative to the other ideas suggested would maybe be having several dice you roll at once? Solid effort regardless, well done!