The secret is that the rocks hardly ever fall in front of you if you keep moving :)
Ah! I was driving really slow, so that explains it!