You get the permit from the merchant Darude in front of your castle once the main story is far enough.
thank u I was so confused
