Oh, controller probably makes it easier, good point, so perhaps just a fix for the mouse then.
I totally forgot to mention, props for adding controller support for this! you don't see it a lot in gamejams, hence why I forgot I could use it