Just something that slapped me right know.
Maybe the secret ingredient of the coffee is a small dose of Love Potion?
He is a lonely satyr who almost-never have guest. He always complains abouy being lonely, so everytime he has a guest, he offer a cup of coffee with a little dosage of Love Potion. Not enough to make you feel completely lost and wishful, but enough for you to feel confident and relaxed around him.
Maybe Love Potion does not have the same impact it has with the others because he is already familiar with it. Not to mention the fact that he knows you put a Love Potion in his coffee, just by drinking it (it's mentioned that the Love Potion should be spotless when you do it with Xeroth, I think).