I believe that this happens because the timer ends and new points spawn while some zombies are near you so you got no time to move to the other points. Make sure to pick points that are far from the others to avoid the contact. At the end this game was originally made in four days for a game jam so it may have some bugs.