one thing you could maybe do is making the wall bounce you further out, so it'd make it harder to aim and control your ship if you bumped a wall?
I'm hung-up on finding a punishment-free way of solving it, but, yeah.... maybe! :)
Or maybe bouncing off a wall disables your gun for a half second? Might be too harsh :/ It's cool though, I enjoyed the game :D