Your idea is great!
However, the controls are really confusing. Maybe mouse controls could be friendlier and the keyboard controls only for speedruns.
Good job, congratulations!