The start menu not coming back is a bug added with 0.3.3.1, it will be fixed in the next version.
When you use an item, you enter a use item context and need to hit the cancel key/button to go back to inventory.
In combat, again use the cancel key/button.
In the store you can cycle characters with the bumpers on the controller or page up/page down.
I know these aren't intuitive right now, especially if you are using mouse and keyboard, but the function is there.
Thanks for the feedback.