I think having one button be selecting and assigning a task would have been better, but I like the concept and management game. After 3 little guys it gets a bit slower, so maybe add another mechanic to keep it interesting. Good job.
At first i've tried a classic RPG Box Selection of multible units, but that made the game way to easy. So i scrapped the idea and changed to single selection with one click.