There is a door facing down, on the 1st floor (the one below where you find it); you can just ram into the door as if you wanted to enter
