A grey portrait means that you lost that girls path, which is essentially her romance side story. This is caused by bad decisions you made during play. If you want to make things right you'd have to load an older save and make different choices. I offer both a written walkthrough as well as a walkthrough mod here if you're interested.