News for hackers. Stuff that matters.
Re:Keeping up with the overwhelming pace of AI innovation by timr on Tuesday March 28, 2023 @07:46PM (#35349786)
No. I linked to a blog article which mentions many different papers, many of which were from 2018 or before. ELMO, BERT, UNILM...all examples of multi-target NLP models that pre-dated GPT.

I didn't dig this up because I thought the date on the webpage was some kind of rebuttal. I picked the first article I saw that mentioned models I knew about, with dates.

> It is also a modified transformer

Well, yes. Exactly. We're in the echo of that work, which was the core advancement that happened circa 2017. As I keep saying, it only seems revolutionary if you haven't been paying attention to the last 5 years.

There are no comments on this comment yet.