I got this too, it confused be a lot but i just went back on my save and said yes.
I ultimately did the same, I just brought it up because the "Why are you avoiding me?" line felt out of place for that specific bad end.
