I think what happened is that the memories were overlapping each other, so that when I warped to one I instantly destroyed the others. A logical result of not knowing the touch = bad mechanic.
