You can find the flower crystals in the Spire of Courage challenge floor. It's in the entrance area where you met Raidy, not in the area where the raid bosses are.
