Big difference. Adventure mode is a standard mode for getting into game, seeing all the characters, having different options for stats and armor builds. It has most of the content.
Story mode is available for Patrons, it is more difficult, as you have scarcely little options for making your character strong. It is much more linear, and it has a unique plot.