IIRC he needs to like you (over 40 I think) and you need to have gotten the lizard tribe's good ending. Then you need to rest at the temple late at night (I think between 20:00 and 2:00) repeatedly.
In addition I think you need to have them go to the village with you.