Ahh darnit, yeah that makes sense, I was calculating their positions based on past frames, which was not a really smart idea lol, I don't have a high refresh rate display to see this issue sadly. 😅
