So confused, I just now tried using a steam controller to connect. Didn't work at all, it thought the controller was my keyboard. I thought, "maybe that's just the way the controller works?" so I tried using my Xbox controller with a Bluetooth connection. Still no success :/
Sorry for the late response, I'm really not sure what the problem is. It should be working. I'll make sure to check the steam controller and Xbox controllers.