To talk to Chloe, you need to have found the Goblin Witch (click on the "Explore" icon in the Outskirts and follow the text clues) and learned her name. Once you have her name (unlocks her in the Heart Menu) you can go to Chloe's bedroom in the Manor - West Hallway in the morning.