Great idea! But I would make the game more chalanging. It's very easy to collect 15 apples and it became boring soon. It would be cool if you saw how many aples are there based on the sprite instead of writing it down.
Also the problem with the jittery movement - I think you change position but you should change velocity of the rigid body instead and unity will figure out what to do :)