Do any of your keys work when you switch? Or is it only the shortcuts? I have a very similar setup, but am finding that using the back button (on the device) switches to "GUI Mode," which puts me in the code editor or console, but for whatever reason disables all key input except for arrows and the return key. Which is a problem for me since I don't have an escape key...
Anyway, I came on here to ask about that and saw your post. Just not sure if it's the same issue you're experiencing.