I liked it, you can even say that the "bugged aiming" is part of the game mechanics. Maybe pretend you only have a one man crew. Forcing you to stop steering to adjust your canon. .
Haha that's what I thought I would use as an excuse last night. "You're all alone you have to stop to aim the cannon!" I even thought about making it a real feature.
