I had the same problem but after he whooped my ass a few times he finally disappeared. You could try making the brew if you haven't but it can be hard when he's hunting you down.
