It's a bit of a "patience meter". Try playing without adding anything to it, or filling it up. There's three versions of a major scene depending on how many points you get.