It should work to delete connections (and after the tutorial delete nodes). Do you see an orange rectangle when you drag a mouse holding MMB? I'm not sure if it is some other issue.