Which of Youmu’s arguments were you on? That flashback does work on a later argument. If it doesn’t though you might have stumbled into a glitch.
I’ll be putting out a spoilered walkthrough later with exact solutions, sorry to hear about that! Glad you at least enjoyed it until that point.