News for hackers. Stuff that matters.
Re:Understanding deep learning requires rethinking generaliz... by rubatuga on Thursday March 04, 2021 @11:33PM (#26352726)
But BERT isn't a generative model? Unless you mean it's trained similar to a generative model by predicting the missing tokens?

Also an interesting paper about hybrid energy based models:

https://arxiv.org/pdf/1912.03263.pdf

It's possible to have a model be both a classifier + generative, and the performance is comparable (although lower) to the SOTA of single-purpose models.

There are no comments on this comment yet.