It's an interesting idea that could be a lot of fun with some more work. One thing I did notice was some odd collision handling. Sometimes I could push against a wall and when I released the key the player would start moving the opposite direction even through I wasn't pushing anything. It seems to range from just a small drift to a large bounce back.