Hey there!
I replied back to you on Discord, but in case anyone else has the same concern: the credentials of newly created leaderboards are cached into your browser, but are not saved persistently. I've mentioned this before in my devlog, but when clearing your browser's cache or once a new update is launched, those credentials are cleared. That is why it's important to store your public keys and secret keys elsewhere.