You gonna need to read about the licenses of:
https://github.com/openai/CLIP
https://github.com/CompVis/taming-transformers
I don't add any additional license on top of the libraries, so if those two libraries allow it, its cool.
Ok awesome thanks so much for the links!
