Yeah, some kind of indicator to show your progress to 4 hits would be really beneficial I think.
As for what to do about your controls, that's a tough one. It is nice being able to move without a virtual joystick. Not really sure what to do about combat though unless you made it passive somehow. I definitely don't think you'll get a joystick and button in portrait mode, so I don't think you're wrong there.