That's quite strange (I've seen videos - thanks to authors) that you haven't added "Hold" control to move objects with the device. It seems like an obvious action.
3d mechanics seem to be really complicated and such simple action could greatly improve the gaming experience.