You should be able to delete them from the "external keys" page if you don't need to hand them out anymore. Click on the page that takes you to the listing and scroll way down. Tell me if you have any issues.
Thanks Leaf, Yeah I already did that, and sent an email a few days ago asking itch to remove the assigned ones too.
