Thanks for the feedback! Unfortunately, we didn't map the dimension switching for controllers yet (we primarily had keyboard bindings in mind when we were making it) but we'll be sure to add it in soon. Sorry about that!
Looks like the Jam Host said it was OK to push quick fixes to add support for another platform, so we've gone ahead and binded the controls for controllers as well. Try giving it a go!
Controls: D-pad: Movement, [PS "O", XBox "B" Nintendo "A"]: Switch dimensions with your time-piece, [PS "X", XBox "A", Nintendo "B"]: Dash