Figured out why everything happened so fast that I died in seconds: the speed is tied to the framerate. I was getting over a 1000 FPS on lowend hardware for today's standards. Limiting to 60 seems to have fixed it. Nice idea on what the difficulty selection does.