Maybe single click to select, double click to move, or something similar. However you go forward with this, I'd love to play more of it.
