Yeah if you had a structure entirely built out of cold iron there would be pretty much no magic allowed inside. That said, imagine trying to build an entire fortress out of even regular iron with medieval technology. This has all the same logistical problems but worse lol.