Hm, I wonder if you could just hide it with CSS instead of removing it, so the code can still find the button. Neat idea tho — I've always just used the HTML file as-is, but you're right — it's better for embedding without all that other stuff.
You can try the minimalist format if you want, it as you say you might lose the loading scenes and stuff, I am. not sure about it I have. Not used it )