I checked and there turned out to be a problem with the obstacle spawning code which meant it never despawned faraway objects. I have fixed it on my local version and will release it as soon as the jam is done.