Testing it again now, it doesn't seem to be happening. I might just have been confused by some lag spikes.