Does the rare room look like the red crystal rooms, just with one of these demon enemies instead of a crystal? Because if yes then the chest still didn't open for me :(
When the second belly size is unlocked, the red crystal rooms will have an enemy inside.
Rare rooms have a waterfall, blue flowers, and play a sparkling sound when found.
