News for hackers. Stuff that matters.
Re:Ask HN: Why do so many assume we’re on the cusp of super-... by lisasays on Thursday May 25, 2023 @08:54PM (#36078456)
Even if the statement were true, the data that these models are trained on is, collectively, smarter than the smartest person who ever lived.

"Smarter" in a horizontal sense. But not vertical.

The latter being what people really mean by "smarter". You know, that thinking-outside-the-box stuff.

That's why LLMs aren't able to "solve" problems that don't have existing writeups somewhere (beyond certain problems more or less equivalent to combinatorial search). Or produce text useful beyond the mild amusement level (or for spam and/or research fraud -- at which it of course excels quite brilliantly).

And still trips over itself narratively, left, right and center. And still makes all kind of cute-sounding, and superficially correct (but ultimately misleading) pronouncements about the world that a true expert would never make.

Taking an example from a recent NYT article: "Give me some useful mnemonics for learning Spanish" (paraphrased slightly):

   Hola:  "Hola, cola" - sounds like "cola" (Coke)
   Adiós: "Adiós, my toes" - rhymes with "toes"
   Gracias: "Gracias, grassy ass" - sounds like "grassy ass"
   Mañana: "Mañana, banana" - rhymes with "banana"
   Uno: "Uno, you know" - sounds like "you know"
   Tres: "Tres, dress" - rhymes with "dress"
As everyone who knows Spanish knows -- none of these really rhymes in Spanish (and if you try actually speaking these words (except the sfollowing the templates given, you'll get laughed pretty quickly). But they're certainly cute, and astonishingly impressive.
Re:Ask HN: Why do so many assume we’re on the cusp of super-... by vannevar on Thursday May 25, 2023 @10:39PM (#36079102)
>That's why LLMs aren't able to "solve" problems that don't have existing writeups somewhere (beyond certain problems more or less equivalent to combinatorial search).

Neither can humans. We create by analogy; "thinking outside the box" just means making less obvious (but still valid) analogies.

>Or produce text useful beyond the mild amusement level (or for spam and/or research fraud -- at which it of course excels quite brilliantly).

People are using LLMs very effectively for writing news reports, opinion articles, legal summaries, and computer code. It's already gone well beyond "mild amusement." There's a reason many companies have had to adopt policies regarding LLMs at work: people are already using them at work.

And sure, LLMs still make lots of mistakes. But they are already better writers than the vast majority of humans, and as I noted, the algorithms being applied are pretty simple yet.

Re:Ask HN: Why do so many assume we’re on the cusp of super-... by lisasays on Friday May 26, 2023 @10:34AM (#36084700)
People are using LLMs very effectively for writing news reports, opinion articles, ...

Well, we certainly differ in our assessments on that. Literally everything I've seen in the first two categories complete garbage.

Re:Ask HN: Why do so many assume we’re on the cusp of super-... by vannevar on Sunday May 28, 2023 @01:34PM (#36106071)
Literally everything I've seen in the first two categories is complete garbage.

You are assuming that you are aware of the origin of everything you read. I suppose that's possible, but unlikely. At this point the use of generative AI is widespread enough that it's likely that you've read material that you were not aware was AI generated, at least in draft form.

Re:Ask HN: Why do so many assume we’re on the cusp of super-... by lisasays on Monday May 29, 2023 @02:38PM (#36116633)
I think it depends a lot on the sources one pulls from, actually.

It would be a major scandal indeed if a stalwart source (like the New Yorker, say) were to be caught trolling its readers with generative content. Also very difficult to keep secret for long (if done at scale), the way the literary world works. Assuming that could even happen, given the current SOA (which from the samples I've been seeing, even those touted as "mind-blowing", seems highly doubtful).

Meanwhile if one's daily bread is from intrinsically spammy sources like BuzzFeed et al - I agree that one will scarcely notice the difference.