I think after accepting the flower, you'll have to wait for the next playthrough to get access to his route! The first event will then be something like "Have we met before?"
