Hello, yes E is the only button you can use. It allows you to choose your character and to hit when the sword glows.
We also know there is some latency due to the too long sword animation, sorry about that (・ω・)