I already found the way, I just didn't realize that diving cancels fall damage.
That one is a bit unintuitive but I guess it also makes sense because it alters the way you fall.
