The most likely answer is that there's a room somewhere that you haven't gotten everything from, or there's a type of item (like broken barrels) that you're missing.
I've done that quest probably over a dozen times now, and I tend to miss either the closet next to the coat check, the larder beneath the kitchen, or the rooms in the west wing of the second floor.