Yes, there's a hidden mechanic where the choices add to each girls' score. Eventually you'll be put on the path of the girl with the highest score. It's not as simple as "pick the girl you like when James asks who your favorite is" (though that choice does add to the scores).