Sorry, yes, you can delete the old APK but don't delete or uninstall the game :P That'll teach me not to proof-read my own posts!
And thanks for the kind words! I'm glad you're enjoying the game, and I hope you continue to enjoy everything I have planned for the future! :)