Mail needs to be delivered to the proper address, pressing tab shows which houses need mail, then its up to you to find that house.
