That problem is caused by the game failing to save. Possible reasons are that the Saves folder is set as Read Only or is in a Read Only directory, or that you're attempting to play directly from the .zip file.
I've since added a warning screen that tells this to you when the game starts if it's unable to save or load and lets you progress with saving disabled if you want, so that will be in 1.05