I can see the potential! I enjoyed playing it (it gets very hypnotic and I lost several hours there lol) but it def needs some polish. Some form of map seems helpful if the world is going to get that big, for one thing. I also had a few issues trying to direct a task only to either unclick (accidentally or to do something else) or wait a long time, and viable Lil Fellas would wander around the target but not actually jump it.
Would love to see more! Kinda reminds me of Pikmin. You could capitalize on the general chill and make it more of a meditative game if that makes any sense.