I'm okay with the fact that we have to start over but is there any way to delete the old saves from appearing in "Load" and "Save" ?
Hover them and click "delete" on the keybord. That should pop up a question if you really want to delete the saves. You can also go to the folder where saves are stored here C:\Users\[YourUserName]\AppData\Roaming\RenPy\LustfulDesires-1520529303
