News for hackers. Stuff that matters.

A comment on Major Outage Across ChatGPT and API. Parent comment

Re:Major Outage Across ChatGPT and API by taneq on Wednesday November 08, 2023 @07:26PM (#38199265)
If there's one thing that's becoming clear in the open source LLM world, it's that the dataset really is the 'secret sauce' for LLMs. There are endless combinations of various datasets plus foundation model plus training approach, and by far the key determinant of end model performance seems to be the dataset used.
[ Parent | on HN ]
Re:Major Outage Across ChatGPT and API by satvikpendem on Wednesday November 08, 2023 @07:33PM (#38199310)
> it's that the dataset really is the 'secret sauce'

alwayshasbeen.jpg

There have been articles about how "data is the new oil" for a couple of decades now, with the first reference I could find being from British mathematician Clive Humby in 2006 [0]. The fact that it rings even more true in the age of LLMs is simply just another transformation of the fundamental data underneath.

[0] https://en.wikipedia.org/wiki/Clive_Humby#cite_ref-10

[ Parent | on HN ]
Re:Major Outage Across ChatGPT and API by still_grokking on Thursday November 09, 2023 @04:27AM (#38202832)
2006?

https://en.wikipedia.org/wiki/Scientia_potentia_est

[ Parent | on HN ]
Re:Major Outage Across ChatGPT and API by sharkoz on Thursday November 09, 2023 @06:41AM (#38203787)
The best answer to this is https://www.youtube.com/watch?v=ab6GyR_5N6c :)
[ Parent | on HN ]
Re:Major Outage Across ChatGPT and API by satvikpendem on Saturday November 11, 2023 @02:26AM (#38228271)
> There have been articles about how "data is the new oil" for a couple of decades now, with the first reference I could find being from British mathematician Clive Humby in 2006

I am specifically referring to the phrase I quoted, not some more abstract sentiment.

[ Parent | on HN ]