Because you have a slave mark, you are not human, you are a property. A run away property at that. If you are at Fishtopia Island you can build a raft using lumber to escape back into Noir Island. If you are at Noir try to get some money and go to Elise to remove your slave brand.