There is a square building where you find a green orb, right to the left of it (left of you when you look at the building) there's a path leading down.
You also see another square building further to the left which can't be reached normally, that makes it even more "clear" that you need to find another path to it, and voila there's that path inbetween them.
