That's strange, did you click the "QWERTY" line (and did it get the green checkmark)? I watched a few people playing it and they didn't got the issue you mention when switching to QWERTY. Please let me know!
Oh, I'm dumb... I never clicked on any of the lines, just assumed there were multiple control schemes active at the same time. So then that's my fault and not yours :D
