Only professionals of this game will be able to kill him >:D
Finally I've killed him and beat the fiddler. I suppose sword hits much more than gun. Also, I kept traveling at the top of mountains.