You need to do at least the basic home harem first (Bree and Sasha)
Then depending on the path you took with Sam you may or may not be able to