Thanks! First time making an isometric game - the lesson here is to make the movement to related to the camera, but to the world space.
