I had already acquired the big characters and put them in a room, I then wanted to rearrange the room layout because I didn't like how it looked. So I sold most of the rooms and put them back in a different spot and... poof.
Couldn't put back any of the big characters.