You need to distract him I forgot how but you need to get a pot from the house and go to the fishing dock then make noise the shadow will leave and you can go there's also a cutscene once that's done