Nice idea, nice implementation, but I have a couple pieces of feedback to make it smoother:
Having to move the hands between mouse and keyboard gets quite annoying. I'd be happy with a full-keyboard (and full-gamepad, and optionally full-mouse) control scheme.
Also, if I'm controlling one piece and click on another, I'd expect to move the control directly to the other piece, instead of having to click twice.