It might be better for the player if you lower the odds of higher numbers appearing. Hell breaks loose a bit too quickly. If you slowly ramp up the odds of higher numbers appearing, you can increase the difficulty over time.
