Ah, you don't need to apologize! You just need to insult him three times without apologizing and you will get the scene when you return to him.
