I figured it out... Embarrassingly enough, I needed higher romance so I took him on a date and was successful!
