You don't need to know the color for each number just press the same number on the keyboard as the tile (except for num pad that hasn't been implemented yet)