You keep them. Don’t need to worry about that.
The events just basically check if you had any d4s left, if so they get upgraded.
