It's been a while since I last played his route but from what I remember there's two occasions where his (or any RO's) relationship status changes, I can't remember the first one but the second is during the Crowns Coronation meal when you both have the heart to heart, there's a few choices during that conversation and depending on the outcome of that your relationship will either be fine or struggling :)