Can't you drag and drop the items off of the crafting board? It's probably not something worth adding a button for though, the fewer buttons the better.
oh sorry you can, i didn't realize the hitboxes on the items was so big