This is unhinged, in the best way!
You might be able to get better image quality by using ffmpeg to explode the video into individual frames and then performing the dither on that batch of images using imagemagick, like I described elsewhere, before fusing them back together into a GIF.
I'm really looking forward to seeing where you go with this idea.