News for hackers. Stuff that matters.

AranKomatsuzaki

Re:State-of-the-Art Image Generation Models on Friday March 05, 2021 @03:33AM (#26354376)
Thank you for your feedback :)

As shown in a figure in the section of VQGAN, VQGAN offers superior quality over VQVAE2 for a given amount of compute budget, and given that the generator of VQGAN is based on an architecture similar to VQVAE-1/2 (like DALL-E), it does not suffer from mode collapse or instability you mentioned.

Re:State-of-the-Art Image Generation Models on Friday March 05, 2021 @03:21AM (#26354287)
Thanks for your feedback! Actually when I wrote the article, I feared this may confuse the reader.

The reason why VQGAN (taming transformers) has good quality (possibly the best as you said) is precisely because it uses an idea from GAN (not because of quantized VAE). So, this model is not really VAE, but it's a combination of VAE and GAN just like DC-VAE model that was also featured in the post.

If you take a look at VQGAN's section, you can see a comparison between DALL-E and VQGAN, the former of which uses substantially more resources and no GAN technique. THe latter shows much better quality, which shows that GAN really offers much better quality.