Are you playing in an emulator like WinUAE?
If you are, you need to configure the input device to act like a CD32 joypad, and not just a normal joystick. For WinUAE, in the menu (F12), go to "Game Ports", for Port 2 select your controller, and then under that change it from "Default" to "CD32 pad"
