After a lot of testing, it seems you need to gold down the left trigger, then click down the left thumbstick in the direction you want to turn.
Obviously slows the game down a lot and kills a lot of the immersion, but at least its possible!
