Update on this:
After testing my own JoyCons, some reason the game cannot register my up and left inputs for the joystick, but it can register down and right just fine.
We're using singular JoyCon by the way, mainly because even though I would use BetterJoy, I heard uninstalling BetterJoy was really obnoxious to do.