There's a secret entrance right above the plant (Just mash your head into the nearby walls and corners until you find it) and you can place some fairy dust, then just speak to the woman and give her an offering. (I just do angel milk but any would do)