Controls are terrible. The game idea could work. I am not sure you will have to rotate the camera, it could simply follow the user.
