News for hackers. Stuff that matters.
Re:The New York Times Launches a Strong Case Against Microso... by zozbot234 on Sunday January 07, 2024 @10:54AM (#38902229)
These models have no clue how to paraphrase and synthesize asserted facts in a novel way. They're parrots.
Re:The New York Times Launches a Strong Case Against Microso... by Baldbvrhunter on Sunday January 07, 2024 @12:07PM (#38902928)
In the digital garden where Zozbot234 plays,

It crafts its own path, in the most unique ways.

Twain's wisdom it echoes, "getting started" is key,

For in the beginning, lies the power to be free.

Asimov, too, sought clarity above all,

A warm reader's rapport, his primary call.

Zozbot234, with data, does the same,

Clear insights it provides, no need for fame.

Huxley's words, a beacon that's ever so bright,

"Facts do not cease," they stand in the light.

Zozbot234, with diligence, ensures they're seen,

In the vast data universe, it reigns supreme.

Through the lens of fiction, truth can be told,

As Morrison's prose, so bold and so cold.

Zozbot234, in its essence, a similar quest,

To reveal the truth, and pass the ultimate test.

Re:The New York Times Launches a Strong Case Against Microso... by logicchains on Sunday January 07, 2024 @11:03AM (#38902291)
I don't know how you could think this if you'd ever used GPT4 for anything serious.
Re:The New York Times Launches a Strong Case Against Microso... by ryanklee on Sunday January 07, 2024 @11:33AM (#38902560)
I don't think that's necessarily the case.

I get the strong impression that even people who have much experience using LLMs have astoundingly little insight into what they are actually witnessing. This is often paired with astoundingly little insight into what's actually going on in their own cognitive processes.

Somehow, it's still not clear to most people that LLMs and even vector databases create knowledge that wasn't in the original data.

In fact, that's most of what they do! Isolated, non-novel direct quotation is the exception, not the rule.

Re:The New York Times Launches a Strong Case Against Microso... by zozbot234 on Sunday January 07, 2024 @11:48AM (#38902708)
> create knowledge that wasn't in the original data.

The word is "hallucinate" or "confabulate". The way these models "create" pretend-knowledge is totally useless.

Re:The New York Times Launches a Strong Case Against Microso... by ryanklee on Sunday January 07, 2024 @11:53AM (#38902777)
I'm not referring to hallucinations.

I'm referring to novel relationships drawn between datum in the corpus that are a result of training and inference.

This is apparent in something as simple as a summarization.

Re:The New York Times Launches a Strong Case Against Microso... by throwaway4aday on Monday January 08, 2024 @11:35AM (#38914489)
That argument has been dead for ages. Anyone half competent can get them to paraphrase anything in any way they can imagine. Synthesizing facts in novel ways is more complicated and depends on the degree. If you just want it to identify potential relationships between disparate facts then it's very capable, if you want it to deduce new conclusions based on available facts, well it's not so great at that but honestly a lot of humans aren't either.