I think this could be a great game. The idea of enemy hordes and the "stay as long you can" is always fun, but the inverted controls are a poor choice for a theme like this. With a little more of thinking, this could be something really interesting!
