Pretty cool controller already!
I think you need to make the camera leveling to horizon while standing unmoving on a slope, otherwise it feels like a gravity change