You can get into the garden either by going through the back in the top left of the garden, or by disrupting something in front of the gardener and getting him to open the gate.
