Very interesting concept! I feel the precision required to drag a yarn ball might be a little to tight. Consider making the collision a little bigger than the actual sprite. I think that could help with the feel of the game.
