This is a cool little game! Both the theme and the limitation are implemented very well. I think if you fixed the hitboxes and the camera, and added some different levels, this would be a very complete package. Nice work!
When you run into walls, the player is jittering back and forth attempting to not clip into the wall, and since the camera is following the player exactly, it looks like the camera is jittering