Thank you so much for your suggestion. And from that, I have updated the game to only be controlled by one button that is the "Left-Mouse Button" and completely removed any pointer movement.
