Can I do this on the fly? Or I have to kill the game before editing save files?
Yep, you can (except for auto_save.json)
