Sorry if it wasn't clear: But you use the arrow keys and spacebar to dig in whatever direction you are pressing. You can't dig through the stone, so look for dirt that is not white-ish on top.
