You head back to the boat and make your way east, you'll find the ruins in the center of the mountains only accessible by a cave
