Well, you are able to talk to him in crystal caverns in the room you fell in, but I'm still unsure of the exact conditions. You then have to hold a conversation with him. It will make it so that he won't try to kill you on sight. My only advice is this: Don't f*ck up.