Hey, feedback!
Actually, you can use keys and mouse in exactly the same way you described, pressing the letter print on the dice will tell you which ones you should remove (the red ones), but I guess I wasn't really clear enough. Anyway, thank you for the comment!