Once you recruit the pirate, she'll take you to the base island. You can take the ship from there (walk south) sail to the left, up then right and you sould see a number of the islands, land on the one with the tree (I'm recalling from memory) finding the islandsis the least of your problems.