Have you gone through the Sakura Forest? You will find the Carrot Charm there. You will need the Flower Charm in the Garden Maze (next to Bunny Manor), you will need to get the Goddess Slash from Minerva.
Hi DragonPie, the Flower Charm is in the garden, you can find an entrance to the far left-hand side of the map, there will be a chest and a vase (if I remember correctly >_>). The chest contains the Flower Charm.
