News for hackers. Stuff that matters.
Re:When ChatGPT Broke an Entire Field: An Oral History by teruakohatu on Friday May 02, 2025 @02:19AM (#43866708)
That is a really good question, I am not sure where to draw the line.

I think it would be safe to say BERT is/was firmly in the non-traditional side of NLP.

A variety of task specific RNN models preceded BERT, and RNN as a concept has been around for quite a long time, with the LSTM being more modern.

Maybe word2vec ushered in the end of traditional NLP and was simultaneously also the beginning of non-traditional NLP? Much like Newton has been said to be both the first scientist and also the last magician.

I find discussing these kind of questions with NLP academics to be awkward.

There are no comments on this comment yet.