Just because their memories were taken, doesn't erase that they are still related. Even if your MC didn't take the pill in the beginning to keep their memories intact.
The file on the MC's wife says another man fathered the girls. THEY...ARE...NOT...HIS...CHILDREN!!! It has nothing to do with taking the pill, or losing his memories.