When you visit the Boost Station, you can select an already-purchased Boost and a "Turn Off/Turn On" button will appear somewhere below. You can turn off the selected Boost this way.
I looked everywhere for toggle switches expecting them all to be listed somewhere, including in the boost station, i didn't expect them to be in the actual shop, but it makes perfect sense now that i know it's there.