Thank you for keeping it mainly vanilla btw, the drama as it is is the right amount, anything more and id be a wreck :D
As for how to include Sayuri. First off we gotta take care of the husband cleanly, its already been established he is barely ever home so lets just make it clear they are not in love anymore and such.
But even then, Its hard to imagine how Asami would be okay with this, or how her mom would even allow something like this to happen.
The only way I could see it not be really immersion breaking would be if, Asami somehow got into threesomes with the MC and Yasuka, growing more comfortable with the sharing part, then, when/if Noriko joins the definitely not a harem she and Noriko would get into a spat somehow about how her and Yasuka are better for the MC or something, bringing her mome into it, as someone else mentioned here.
Either that, or make it like a dream sequence, or some sort of "random" encounter that the MC will think was a dream or some such, storywise it seems rather hard to fit in.
And oh my god, I cant even imagine, if there will be specific endings for each of the girls (and I hope there will be) how Asami would stomach you breaking up with her to be with her mom :D
Thanks for your hard work and good luck.