I think what was happening is that I was losing a life without noticing and the current piece was getting swapped out for a new piece.