oh, I just saw that you entered that door. You can then jump onto the roofs of the windows to go up.
Yup, that's when I started to get confused hahaha :)