Update: Playing around with possibility of non planar terrain, or at least some change in slope.
Currently just setting the cars up vector to the normal below it and apply gravity in same direction as face normal and it works kinda nice.
No interpolation between angles make it very choppy so had to use follow camera to not get a severe headache while playing around.
Gif of unintended skateboard ramp:
