Yeah, it's not well explained, the idea is that you lose the upgrades when going back before you built them, so you need to use the replicator again.
Thanks for your feedback!