I played again to be sure, and I use X to focus, but it not I noticed that this only happens if I'm also shooting, so when I shoot while focus I can't go up and down
This sounds like a hardware issue. Most keyboards have some limitations on which keys can be held at the same time. You can try changing the key bindings.