Yea, that was common for me too.
And I tried to sync the physics but that didn't go well, so just letting it calculate it (which becomes "random") most of the times affects the simulation...
