It does. It affects what guests you get, your exploration results, Asterion's affection, how some characters interact, etc.
