I already found out that, as always, "most obvious answer, is often the right one."
When she's in the kitchen, it's the same as other animatronics being next to your door. I feel stupid for not understanding that earlier, but I'm already on night 6 and manage getting foxy to come only 2 times. But she always comes to the kitchen at 4AM. So that's a Bai Bai Power moment.