It happens on my side too and I actually have no idea why, I'll try looking into fixing it after awhile. Though I feel it adds a little extra touch, I understand it's not ideal for a wider audience.
It wasn't too bad, I'm just not sure why it did it to be honest. I've heard Harlowe can be 'tempermental' sometimes whenever you try to change it. But it didn't take away from the experience much at all. You might even be right that it kind of jolts you and makes you feel like things are a little more off than they seem.