You are right. A normal person would have put two axis of rotation on the mouse and an alternative button to go into "look mode". That normal person isn't me.
Don't worry, Nintendo made that same design choice when they made the N64 controller.
