Thanks for the details.If you make use of the rigidbody2D component you can avoid the bumps in the wall.This is a quite good tutorial from couch ferret.Maybe it will help you :)
The bouncing off the walls happens so the player won't walk through or get pushed through them
But i will check it out thank you :)