Re:Early Days of AI
by whimsicalism on Monday August 21, 2023 @05:34PM
(#37215659)
From the article,
> The biggest inklings that something interesting was afoot came kicked with GPT-3 launching in June 2020
Yes, I agree with you that if you were in this field, this is quite late to the realization. Most of my grad seminar in NLP in 2018 imagined ChatGPT-style tech would be possible as "language modeling is essentially world modeling."
100% agree the theory on AI is old and actually dates back to the early days of "cybernetics". But the real difference is at what point do we considered it sufficiently reduced to practice? I chose GPT-3 but undoubtedly people can point to earlier examples as glimpses of what was coming for sure.
Edit: Going back through the post, the author’s slide has Transformers labeled as 2017, so he is aware of the history and he’s just emphasizing that GPT3 was the first transformer model that he thinks had something interesting and related to the current AI explosion. I think BERT style models would be worth a mention in the post as the first transformer models found to be widely useful.