Do you still get dominance points forced on you? I seem to start collecting them no matter what either automatically or if I don't want to make minus points. I always play it reading everything, but if I don't have much time I sometimes skip ahead and play it carefully later.
The affinity points you get do not matter if you do not have the right triggers. So you do not have to worry about the dominance poins if you don't activate Cassie's dom path. In the future, I might rework how the affinity points work.