According to the wiki, sex slaves count as girlfriends here. I had also impregnated Samantha during the revenge story scene, but didn't have any sex slaves (or even started the home Harem) and correctly said had no girlfriends.
I guess I missed that part of the wiki. Thanks for the info!