If you only met him once you have to keep delivering until he says he is open for business. Then you can visit him
I've done delivery duty so many times, but I never get another scene with the healer. Are there any other requirements I should know about? Tried checking wiki but not much help