Definitely chaotic, maybe even too much. It feels really frustrating when you press a key right when the controls change. Maybe you could a small pause in-between changes to give some time for the player to adapt (and decrease it over time)?
