You have to invite him to the tavern before you go to the mountain, if the barn doesn't see him please go to the bathhouse
