I did that too, I was able to dash into the rocks and they pushed me back out the other way though.
I tried dashing every direction but I ended up pushed deeper into a rock and no dashing worked.
