Thank you for reporting this. I was able to reproduce this. It seems as though items that contain quote marks aren't being stored properly, fail to change the state and be deleted. The only way to delete these items is to delete the parent collection.
I will look into how to prevent this from happening.