Not sure if it only happens to me but on some days, I can't spend my energy at daytime because there are no available girls to do "stuff" with, resulting in a cowgirl not being able to produce maximum milk. I don't know about the others but this happens to me most on Mondays.
Suggestion: Make the girl inside Bastet's Domain still be available to do "stuff" to pass the time OR make it so the player can skip time without the game turning to night immediately.