It probably means you said something wrong, keep trying! :3
but the issue is there is barely any option to go near him or talk to him?? i only can like twice and i have to use all of the chat options besides one that is " ask again " which i know to avoid since " leave it be and apologize " gets a love point ( the only one i got ;v; ) and i have to use all the dialogue options when repairing the door like " his job. ask about him. ask about the village " and i get no other options to talk to him