If you're on PC, Mac or Linux then yes. If on Android then you can delete the old downloaded files but DO NOT DELETE THE GAME! Or else you'll lose all your saves.
If you're using android you can just download the new apk/installer while not deleting anything, you can go ahead and install the new version and it will update the current version without deleting your saves.