News for hackers. Stuff that matters.
Re:The AI Crowd Is Mad by sph on Wednesday February 01, 2023 @09:28AM (#34610901)
On a philosophical level, I wonder if ChatGPT gives us mostly nonsense because most human output is bullshit.

To paraphrase a famous quip, what if this is proof that 99% of everything humans have created is bullshit? The problem perhaps has never been machine learning but identifying the process that enables we humans to somehow go through life and create objective societal and scientific progress out of a massive pile of nonsense.

I might be completely wrong here, but the next ChatGPT will assume this comment of mine to be absolute truth and happily ingest it wholesale.

Re:The AI Crowd Is Mad by Jensson on Wednesday February 01, 2023 @09:36AM (#34611003)
The average of two true statements can easily become false, so models like ChatGPT will spout nonsense even if it was only trained on 100% truthful statements.
Re:The AI Crowd Is Mad by james-revisoai on Wednesday February 01, 2023 @12:32PM (#34614161)
Can you give an example as to what you mean please?
Re:The AI Crowd Is Mad by b3morales on Wednesday February 01, 2023 @01:27PM (#34615116)
One classic example from linguistics is the two (true) sentences

"Politicians lie."

"Cast iron sinks."

Combine them syntactically and you get "Politicians lie in cast iron sinks", perhaps not completely false but certainly less useful than the component parts.

Re:The AI Crowd Is Mad by thedorkknight on Wednesday February 01, 2023 @10:12AM (#34611539)
It gives us nonsense because it's goal is to generate something that looks like it fits in with training data. You can have training data that is all completely factual and still have a generator spit out nonsense that looks completely correct without fact-checking.
Re:The AI Crowd Is Mad by naasking on Wednesday February 01, 2023 @10:27AM (#34611796)
So, exactly like people then?
Re:The AI Crowd Is Mad by inciampati on Wednesday February 01, 2023 @10:30AM (#34611839)
A key problem is that the transformer operates over very short fragments of text. Long range correlations need to be maintained to ensure 100% accuracy in reproduction/inference of relationships.

I realize this is a philosophical take. It also suggests a technical solution: model longer range correlations. GPTs seem so capable because previous models were not as good at this, but the context lengths modeled with transformers are still extremely short relative to those that we work with.

In result, GPTs are very good at translation and reformatting over short ranges, but struggle to deal with long form texts---a typical technique makes summaries of summaries to build out a model of a longer text. That's hardly ideal, and it's not how our minds work.

Re:The AI Crowd Is Mad by sph on Wednesday February 01, 2023 @12:08PM (#34613652)
That's a good observation, though I'm not sure it's just a matter of longer range correlations, i.e. fixable by merely adding more computational power. The truth problem is fundamentally different than what those neural networks are trying to solve. We got the learning part almost right, we have made no progress towards understanding.

I might be completely off the mark, my knowledge of AI is very limited. But earlier today, while reading on Lisp's history and it's demise during the AI Winter, I very much enjoyed a Wikipedia article describing how symbolic AI, the main paradigm of AI research from the 60s to the 2000s, solves a completely different problem than the currently hyped neural networks—which are very good at learning, but not much more. We might need a complementary, unifying model of both approaches to reach AGI.

https://en.m.wikipedia.org/wiki/Symbolic_artificial_intellig...

Re:The AI Crowd Is Mad by orbital-decay on Thursday February 02, 2023 @02:13AM (#34623231)
Sure, a lot of human output is incoherent, but current models give nonsense for a different reason - they lack many mechanisms typical for human intelligence.