Re:Text to Image Generation
by lucidrains on Sunday March 28, 2021 @10:36PM
(#26617139)
Ryan's Big Sleep notebook https://colab.research.google.com/drive/1NCceX2mbiKOSlAd_o7I...
Aleph2Image notebook https://colab.research.google.com/drive/1Q-TbYvASMPRMXCOQjkx...
I've written a few follow-ups to this, with some public notebooks as well that produce qualitatively different results. If anyone is interested, it should be pretty easy to find the BigSleep method, which steers BigGAN in a very similar way to this, as well as the Aleph notebooks, which use the DALL-E decoder or Taming Transformers VQGAN to generate images with CLIP, depending on the version of the notebook.