Our interpretation was that you give up control of the sword at times in order to trigger circuits in the level, but I agree that the level design could do more to emphasise that loss of power.
Thanks for the feedback!