To get the barrel stacks, fight him multiple times. The more you fight him the more it goes up, but it goes down a bit at the end of each day.
And you can't get the scene again. After going through the scene he'll be gone for a couple of days and then appear at the pier's bulletin board. That's it for now though