Ah! There's the issue. I never made it clear enough in the game, but if you lose a key it reapawns where you originally found it :)
Ooooooooooooooooooooooh. Well, then it's all hunky dory on that end, then! But yeah, that sounds like an important thing to let the player know~