And the gamepads... Umm, it's pretty weird. It is possible that you have a program like Xpadder open or something like that that messes the inputs of the gamepads?
So, after much searching, it turns out the culprit was having Xbox configuration support "on" in Steam settings. If one turns it off, all works fine. :-)