So what’s making it hard to control is the momentum of the ship. The ship accelerates really sharply and it takes a little bit too long to initiate a turn relative to the speed it’s travelling at. As a result, rather than gently steering around obstacles, it shoots way too far to the side and then you have to constantly try to avoid overcorrecting and careening into a wall.
The solution is probably to reduce the rate of acceleration and thus momentum of the ship. Run some playtests with different acceleration and speed variables and see how it goes.