The other way to lose Korg is to, much later in the story, get a black heart with him. Thus far in game, getting a black heart is an irrevocable 'this character absolutely hates you forever' sort of result.
Korg's gives you plenty of warning, though, so it's not likely you did that by accident.
