Mouse movement is not a button, as far as I know. So as long as you use only one button, you should be fine.
