The reason the enemies can drop on you is they drop where you have been in the past, if you go there again you can be unlucky with the spawn timing.
