I really like the idea! It can be a bit frustrating if you get caught in between two enemies. Maybe make the change in controls somewhat predictable so one could play around it :)
