I think you need just to ensure that every asteroids that will potentialy reach the player are already Visible in screen when light turns off. So 2 options, 1 reducing speed but it will be easier or, 2 reducing the Time light off so you Can keep fast speed ;)
