Actually, I accounted for that by making difficulty partially increase based on time, which makes it a disadvantage to do that. I just didn't do the RoR-type difficulty meter to indicate that yet.
Ah I see, very smart, can't wait to see the finished game :D