To be precise, first your controller must be plugged in and turned on before starting the game, and once you have clicked on Change, you have to press the same button on your controller twice AND not all buttons on all controllers will work for that. Only once a controller name appears in the textbox above, you can configure keys.
And omg wtf no, you don't have to delete the entire game folder!!! You only have to delete the input.ini file, and restart the game!