Also, I don't think it gave me a skill point for level 5 when I played it on normal.
Not possible. I tested it many many times and the game must give you additional point after beating "new" level (plus new achievements).
Yeah. I went back and realized that my right arrow key was being a little sticky. It upped my health without me noticing.