Are language models deprived of electric sleep?

Re:Are language models deprived of electric sleep? by rytill on Saturday July 23, 2022 @10:59AM (#32203913)

What about diffusion models? (And all the other things with less publicity that aren’t that)

[ Parent | on HN ]

Re:Are language models deprived of electric sleep? by benreesman on Saturday July 23, 2022 @11:06AM (#32203974)

Sure, I’m obviously being a big glib.

So it’s transformers plus let’s force some loss into the super-resolution pipeline.

“Residual” sounds a lot fancier than X = fn + X, and “Diffusion” sounds a lot fancier than “let’s do deconv repeatedly and jam a loss term in there”.

My point is all of this stuff is on Huggingface. You/I/We just don’t have 5k A100s for 6 months, so we can’t play.

[ Parent | on HN ]