I think that would somewhat ruin the simplistic 4 button nature of the game as well as removing some iconic tricks, changing the driving style and possibly putting new players off the game.
I completely agree, controller should not be allowed unless the advantage is removed somehow, which I don't really want because I love the way the game is now