Maybe you need more friendship/desire points with him, check the guide --> https://lust-odyssey.fandom.com/wiki/Rylan