You should disable the rotation on the Player's rigidbody and set the bullet's colliders to "trigger" so they don't move the enemies when you shoot at them.
It would also feel better if the player was shooting in the direction of the mouse instead of the one he is moving to.