The shadows left behind was intentional. I liked having a part of anything that died while you were playing left visible so you could see where conflicts had occurred.
There is currently no way to deselect a worker apart from selecting another worker. I'll fix this though—and make it so you could click a selected worker to deselect it.