Permanent upgrades are acquired by spending rare golden seeds on a variety of upgrades. I originally had some caps on the amount of seeds you could spend for different upgrades, but have adjusted that now to have infinite upgrades with diminishing returns per seed spent:
