I wish there was a way to close the dialog too, it's on my to-do list.
You'll see more challenging enemies later, don't worry about that.
