That was one aim of the game to force you to do arithmetic and that bad decisions, ie picking up the wrong number, has consequences. But your point is something I was having issues with deciding, at the moment not sure what the answer could be, a simple undo might take away too much jeopardy in catching, avoiding or destroying the numbers.
Thank you for your feedback.