Seems to me like unity has kept the reference alive - have you tried closing and reopening the project? Unity loads DLLs into memory and doesn't unload them, so if you move them it sometimes complains. In theory, there is nothing there that forces it to be in that directory!