News for hackers. Stuff that matters.
Re:Ideas in statistics that have powered AI by 317070 on Friday July 09, 2021 @07:46AM (#27782688)
I think VAE's haven't been the state of the art since around 2016-2017? They have been squeezed from both directions, autoregressive models on the compression side, GAN's on the generation side.

They are still fairly competitive on both sides though.

Re:Ideas in statistics that have powered AI by _delirium on Friday July 09, 2021 @11:09AM (#27784460)
Yeah, I guess I was thinking of VQVAE as a state-of-the-art example, but it was indeed 2017. Time flies! It's still pretty influential on newer systems though, e.g. OpenAI's DALL-E that made waves earlier this year has a VAE component (in addition to a Transformer component).