Ah you have to stand on the same spot as the apples~ I should probably have made them fall off the trees if you interact with the trunk or something.I'll look into adding that once I collected more data for a next patch!
thanks for the info