News for hackers. Stuff that matters.

A comment on Three senior researchers have resigned from OpenAI. Parent comment

Re:Three senior researchers have resigned from OpenAI by augustulus on Saturday November 18, 2023 @07:23AM (#38318740)
nothing I’ve seen from OpenAI is any indication that they’re close to AGI. gpt models are basically a special matrix transformation on top of a traditional neural network running on extremely powerful hardware trained on a massive dataset. this is possibly more like “thinking” than a lot of people give it credit for, but it’s not an AGI, and it’s not an AGI precursor either. it’s just the best applied neural networks that we currently have
[ Parent | on HN ]
Re:Three senior researchers have resigned from OpenAI by calf on Saturday November 18, 2023 @07:36AM (#38318866)
As a layperson, what does the special matrix transformation do? Is that the embeddings thing, or something else entirely? Something about transformer architecture I guess?
[ Parent | on HN ]
Re:Three senior researchers have resigned from OpenAI by augustulus on Saturday November 25, 2023 @11:07PM (#38419080)
https://nlp.seas.harvard.edu/2018/04/03/attention.html
[ Parent | on HN ]
Re:Three senior researchers have resigned from OpenAI by keepamovin on Saturday November 18, 2023 @07:27AM (#38318773)
I'm not saying OpenAI is close. Collectively we are tho. The train is rolling, unstoppable momentum. We just have to wait.
[ Parent | on HN ]