Honestly, I totally get you. Was the same feeling for some of us too xD. We will tweak some of the parts to make the experience more smooth.
Hey. It's a UX overlook from our side. The idea is that the collectible can only be picked up by the builder of the same color. (-: