News for hackers. Stuff that matters.

A comment on ChatGPT Creator Is in Talks for Tender Offer That Would Value It at $29B. Parent comment

Re:ChatGPT Creator Is in Talks for Tender Offer That Would V... by dwaltrip on Thursday January 05, 2023 @08:49PM (#34269904)
> The current solution of 500b parameters or whatever is literally just a lookup table of existing data. They could replace it with an SQLite database with the same amount of data and get the same solution.

I'm pretty sure this is completely false?

[ Parent | on HN ]
Re:ChatGPT Creator Is in Talks for Tender Offer That Would V... by pifm_guy on Thursday January 05, 2023 @09:17PM (#34270109)
Correct.

ML papers always try to find the most similar examples in the training set, and rarely find a close match.

[ Parent | on HN ]
Re:ChatGPT Creator Is in Talks for Tender Offer That Would V... by ClueslessTech99 on Thursday January 05, 2023 @09:52PM (#34270362)
How so? What would be the difference? Other than being unviable.
[ Parent | on HN ]
Re:ChatGPT Creator Is in Talks for Tender Offer That Would V... by dwaltrip on Saturday January 07, 2023 @03:07PM (#34292108)
I don’t have a deep understanding of how these language models work, but what do I know makes think that saying “It is basically a lookup table” is sort of like saying “A car is basically a bike”.

Sure, there are some very vague similarities, but they are also incredibly different.

A bike and a car both take you places. But the kinds of places they can take you and how effectively they do so differs vastly.

Likewise, both lookup tables and LLMs take an input and then spit something out. But the similarities basically stop there.

[ Parent | on HN ]