I guess because he was planning to kill them from the start and it seems to me that the other were suspicious of him so they would not believe him if he said it was you
that makes sense but he also said "I would REALLY hate to lose you" and maybe he though they wouldn't do anything about it