Ok, so good news and bad news. I went and retried it and managed to get something going, but it still reaches a point where my character just flies up no matter what I do. Also, I figured out why I was struggling the first time, you start in the flat position which gives no control, so have to press E as soon as you start.
Look, I like the idea you had here, practically I just can't get it to work for me.