I didn't know you could delete saves like this.
In any case, save files for RenPy games are stored in two places: in the game's directory there is a subdirectory /game/saves and in /AppData/roaming (for Win 10) there is a subdirectory /RenPy that contains config and save data for all your RenPy games.