Some of the fruits were actually spawning IN THE FENCE. I made a new build yesterday to fix that, so that shouldn't be happening anymore :P