That's weird. Are you sure you found all 4?
I think it was just a one-off glitch. When I reloaded from an earlier save, and went through again, it let me slot them all.
