Honestly for the local AI you could probably include a local hosting solution and phi-3-mini with your custom instructions ready to go fairly easily, though sure that'd make the filesize like 8.5GB ish but still.
Docker container downloaded separately maybe?