You can right click to clear your inventory! Or just don't use the broom. It's not a necessary item, it just provides hints.
I've patched the issue out for the downloadable version, but AGS's web porting system has changed since I released the game so I haven't managed to fix the browser version yet. Hopefully soon, though...