It should be possible. If you set up your layers so that only the neutral position (the finger resting over the buttons) is visible before any states are active, then it should revert to that point when those states deactivate again.
To help you understand the expected behaviour:
Internally, the default visibility of every layer is saved and updated whenever there are no states active. The States are added to a stack when they're activated, so it starts from the defaults, then adds each State effect one by one in order of activation. When the State is deactivated, it's removed from the stack, so it should stay at default when no states are active.
If that's not happening for you, let me know because that would be a bug.