On Windows the game tries to save in the directory adjacent to the Celeste.exe. If it doesn't have permission to do so this could cause it to crash.