I actually really like this concept. Feels a bit addictive somehow. It does need some getting used to, though. Most of the time, quick movements result in just upward motion, so maybe tuning the controls a bit could benefit the user experience.
It definitely has potential to be a full game with tricky and challenging puzzles/levels.