I was having a lot of trouble with this game until I pick up a controller. Once it became just a little more responsive the whole thing just clicked :)
Yeah, you need some time to get into the controls and I have to admit that picking put toys is not perfect. But a controller helps a lot because you get the additional accuray with the analog stick.