I am clearly missing something that's right in front of me, please help.

Bandages cannot be used in the mansion, only in the field. Secondly, said bandage needs to be in your travel bag, not the manor chest. So, hope that answers your question.

What Rendrassa said. Also, you can heal in town if you transfer bandages in your backpack and then click the bottom right " control" icon.