Actually... no :D Do you still have the stable key with you?
when the horses are in the stable you can talk to the innkeeper again to get a different reply. if you try to talk to the villagers after the horses are in the stable, the innkeeper will ask you to give her back what belongs to her. If you do so, you may finally talk to the villagers. That is the trigger to progress, not just waiting.
You are with puzzeling just ahead of the story, that's why you're not getting the whole picture. Yes, the coachman won't return. But initially you don't know. And from a logical perspective, what you would do in that situation is asking for a room for the night, put the horses in the stable, and then ask again in the inn if somebody had seen the coachman. That's the idea behind it. You wouldn't search all the locations before you know that you're searching something, which is revealed later as you progress and then the items make sense :)
PS: if you found the torch, there is not more to do at this moment at the graveyard. there will be later.