News for hackers. Stuff that matters.

A comment on I Am Tired of AI. Parent comment

Re:I Am Tired of AI by StrLght on Saturday September 28, 2024 @04:07AM (#41678713)
Which ones are you referring to?

Just to make it clear, I see only 1 breakthrough [0]. Everything that happened afterwards is just application of this breakthrough with different training sets / to different domains / etc.

[0]: https://en.wikipedia.org/wiki/Attention_Is_All_You_Need

[ Parent | on HN ]
Re:I Am Tired of AI by cubefox on Saturday September 28, 2024 @09:22AM (#41680079)
Autoregressive language models, the discovery of the Chinchilla scaling law, MoEs, supervised fine-tuning, RLHF, whatever was used to create OpenAI o1, diffusion models, AlphaGo, AlphaFold, AlphaGeometry, AlphaProof.
[ Parent | on HN ]