Neat idea! :) The pacing is really brutal though: I found it almost impossible to get back into the game once I fell behind... Maybe it would be easier if one could also clear a dice further behind? That should end the combo of course, but would buy one a little time to reorient themselves.
Could make a fun mobile game as well. :)