News for hackers. Stuff that matters.
Re:Modern-Day Oracles or Bullshit Machines by ctbergstrom on Sunday February 09, 2025 @05:52PM (#42994948)
Yes!

First, thank you for the link about CoT misrepresentation. I've written a fair bit about this on Bluesky etc but I don't think much if any of that made it into the course yet. We should add this to lesson 6, "They're Not Doing That!"

Your point about humanities courses is just right and encapsulates what we are trying to do. If someone takes the course and engages in the dialectical process and decides we are much too skeptical, great! If they decide we aren't skeptical enough, also great. As we say in the instructor guide:

"We view this as a course in the humanities, because it is a course about what it means to be human in a world where LLMs are becoming ubiquitous, and it is a course about how to live and thrive in such a world. This is not a how-to course for using generative AI. It's a when-to course, and perhaps more importantly a why-not-to course.

"We think that the way to teach these lessons is through a dialectical approach.

"Students have a first-hand appreciation for the power of AI chatbots; they use them daily.

"Students also carry a lot of anxiety. Many students feel conflicted about using AI in their schoolwork. Their teachers have probably scolded them about doing so, or prohibited it entirely. Some students have an intuition that these machines don't have the integrity of human writers.

"Our aim is to provide a framework in which students can explore the benefits and the harms of ChatGPT and other LLM assistants. We want to help them grapple with the contradictions inherent in this new technology, and allow them to forge their own understanding of what it means to be a student, a thinker, and a scholar in a generative AI world."

Re:Modern-Day Oracles or Bullshit Machines by globalnode on Sunday February 09, 2025 @07:59PM (#42995817)
I'll give it a read. I must admit, the more I learn about the inner workings of LLM's the more I see them as simply the sum of their parts and nothing more. The rest is just anthropomorphism and marketing.
Re:Modern-Day Oracles or Bullshit Machines by maccaw on Sunday February 09, 2025 @08:37PM (#42996054)
Funny, I feel the same way about humans.
Re:Modern-Day Oracles or Bullshit Machines by rockskon on Sunday February 09, 2025 @11:56PM (#42997080)
Whenever I see someone confidently making a comparison between LLMs and people, I assume they are unserious individuals more interested in maintaining hype around technology than they are in actually discussing what it does.
Re:Modern-Day Oracles or Bullshit Machines by williamcotton on Monday February 10, 2025 @02:13AM (#42997692)
Someone saying "they feel" something is not a confident remark.

Also, there's plenty of neuroscience that is produced by very serious researchers that have no problems making comparisons between human brain function and statistical models.

https://en.wikipedia.org/wiki/Bayesian_approaches_to_brain_f...

https://en.wikipedia.org/wiki/Predictive_coding

Re:Modern-Day Oracles or Bullshit Machines by rockskon on Monday February 10, 2025 @02:50AM (#42997858)
Theories and approaches to study are not rational bases for making comparisons between LLMs and the human brain.

They're bases for studying the human brain - something which we are very much in our infancy of understanding.

Re:Modern-Day Oracles or Bullshit Machines by mr_toad on Sunday February 09, 2025 @06:28PM (#42995229)
Current LLMs are not the end-all of LLMs, and chain of thought frontier models are not the end-all of AI.

I’d be wary of confidently claiming what AI can and can’t do, at the risk of looking foolish in a decade, or a year, or at the pace things are moving, even a month.

Re:Modern-Day Oracles or Bullshit Machines by ctbergstrom on Sunday February 09, 2025 @06:40PM (#42995312)
That's entirely true. We've tried hard to stick with general principles that we don't think will readily be overturned. But doubtless we've been too assertive for some people's taste and doubtless we'll be wrong in places. Hence the choice to develop not a static book but rather living document that will evolve with time. The field is developing too fast for anything else.

With respect to what the future brings, we do try to address a bit of that in Lesson 16: https://thebullshitmachines.com/lesson-16-the-first-step-fal...

Re:Modern-Day Oracles or Bullshit Machines by mr_toad on Sunday February 09, 2025 @07:32PM (#42995642)
> we don't think will readily be overturned

I think that’s entirely the problem. You’re making linear predictions of the capabilities of non-linear processes. Eventually the predictions and the reality will diverge.

Re:Modern-Day Oracles or Bullshit Machines by habinero on Sunday February 09, 2025 @08:09PM (#42995883)
There's no evidence to support that's the case.
Re:Modern-Day Oracles or Bullshit Machines by interstice on Sunday February 09, 2025 @08:28PM (#42996007)
Said the turkey to the farmer
Re:Modern-Day Oracles or Bullshit Machines by falcor84 on Monday February 10, 2025 @06:42AM (#42999218)
I don't think that's how that metaphor works.
Re:Modern-Day Oracles or Bullshit Machines by interstice on Thursday February 13, 2025 @06:40PM (#43042901)
Not quite, but it was the closest pithy quote I could think of to convey the point that things can be false for a long time before they are suddenly true without warning.
Re:Modern-Day Oracles or Bullshit Machines by habinero on Sunday February 16, 2025 @02:09AM (#43066050)
How about "Yes, they laughed at Galileo, but they also laughed at Bozo the Clown?"

We heard alllllll the same hype about how revolutionary the blockchain was going to be and look how that turned out.

It's a virtue to point out the emperor has no clothes. It's not a virtue to insist clothes tech is close to being revolutionary and if you just understand it harder, you'd see the space where the clothes go.

Re:Modern-Day Oracles or Bullshit Machines by pama on Sunday February 09, 2025 @08:42PM (#42996080)
Every time someone claimed “emerging” behavior in LLMs it was exactly that. I can probably count more than 100 of these cases, many unpublished, but surely it is easy to find evidence by now.
Re:Modern-Day Oracles or Bullshit Machines by kykeonaut on Sunday February 09, 2025 @06:50PM (#42995382)
The post seems to be talking about the current capabilities of large language models. We can certainly talk about what they can or cannot do as of today, as that is pretty much evidence based.
Re:Modern-Day Oracles or Bullshit Machines by dullcrisp on Sunday February 09, 2025 @06:39PM (#42995307)
They saw you coming in part 16.
Re:Modern-Day Oracles or Bullshit Machines by beezlewax on Monday February 10, 2025 @03:23AM (#42998020)
That shouldn't give them any more merit that their current iteration deserves.

You could say the same thing about spaceships or self diving cars.