I like the idea - but progession is slow if you can only interact with each traveller once - why not sell beer and send them on a quest
Also they collected taxes and at the same time a Quest was finished and that bugged out the dialog system