An update is that it seems to happen more and quicker in sessions with multiple players then a single player.
