Yeah, right now it autosaves always - what the game over will do instead is make it so that selecting Continue will just start a new game.
We'll have a mode for more permanent, manual saves as well - right now it's by auto-save only.