You can find the tower by going to the ice teleportation crystal in the frozen continent, and trying to TP from there.
