Does it work ok if you unplug one of them?The game tries to use whichever controller has detected input last. Perhaps the deadzone on one of them is a bit off, which causes it two switch between controllers?