You have to equip the correct set of clothes, you can ask the buttler at the 1st floor's bottom left room of the mansion for the correct set
