News for hackers. Stuff that matters.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by thecupisblue on Friday April 07, 2023 @01:33PM (#35484371)
Besides it being impossible to implement, the 6-month pause would do nothing but give a 6 month competitive advantage to OpenAI over everybody else. They could sell the model access model to companies without having any competitors on the market.

The whole "pause AI or it will destroy the world thing" is just a large pot of hype anyways, pushed by journalists lacking the understanding of technology, twitter-bros who are building "AI copywriters" and "profile photo generators" and owners of "AI" companies.

While AGI is still quite far away, it's common to see people included in the process claiming "it's showing signs of general intelligence", "it's becoming self-aware" etc. Hell, they got a horse in the race and that horse can earn them billions of dollars - of course they would claim it's insanely advanced. And the journalists just regurgitate the claims because it generates clicks.

If Sam comes out tomorrow and says "he is afraid of GPT4", tens of thousands of clickbait articles about it will come out, together with rebuttals and opinion pieces. Millions of dollars worth of ads will be sold via those articles. The value of OpenAI will increase in public's eyes and more corporations will be interested in including GPT in their products, thinking it's going to revolutionise their line of business.

And of course, we have the VC's investing in "AI" products, hyping it up even more - wouldn't you do the same if you had few hundred million invested in 50 different companies and each tweet/article could increase the potential of them raising more money?

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by adeon on Friday April 07, 2023 @01:49PM (#35484577)
AI winter can't come soon enough. It's annoying because I am also enthusiastic and excited about all the constant AI improvements, I follow AI topics on HN and on some of the ML reddits.

When I'm reading on AI news and articles the good stuff drowns in the hype stuff peddling wildly extrapolated capabilities that supposedly will change the world overnight.

And watching some GPT application headlines on HN it's hard to distinguish what is actually remarkable product or research idea from an overhyped this-can't-actually-ever-work-like-this thing.

I forgot where I read this but I think there's a proverb that I suspect applies to the current hype: people overestimate impact of new technology on short term but underestimate long term.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by Karrot_Kream on Friday April 07, 2023 @01:53PM (#35484641)
While I don't agree about wanting a winter, I feel your pain. I'm personally not that annoyed by people hyping up what they're building, because building stuff takes at least some effort. I'm more annoyed at the high temperature discussion surrounding AI which makes it hard to talk concretely about what new ML models can actually get done. I wonder if there's any solution to the problem of the hype cycle.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by akiselev on Friday April 07, 2023 @01:58PM (#35484704)
> high temperature

The discussions around here are a lot more interesting with a higher GPT temperature.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by verdverm on Friday April 07, 2023 @02:20PM (#35484988)
if it gets too high, it turns into gibberish, maybe we just need an e-drug for AI... They had them in Nier Automata, which by the way is a fantastic story and commentary (even if written prior) given the GPT conversation
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by bbor on Friday April 07, 2023 @01:52PM (#35484629)
What probability do you assign to the possibility that you're wrong, and that this flawed breakthrough is the inflection point for an intelligence explosion, and thus really "the biggest invention since fire" as some have said? Just curious - you seem very confident.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by ComplexSystems on Friday April 07, 2023 @02:11PM (#35484858)
0.

If it's possible to "accidentally" build an AI which can "accidentally" hack out of or into secure systems, steal the nuclear launch codes, and subjugate an entire country, then it's also possible to train one to do those things on purpose. If security vulnerabilities exist that make it possible to do those things, then exploitation of them is in no way tied to building any kind of "AGI system" at all, and we can assume many people would be interested in such things right now, before this critical AGI point has been reached.

The solution is to be proactive and determine what vulnerabilities exist that a hypothetical rogue AI (or, more likely, a deliberately weaponized AI) could take advantage of, by training models that are increasingly capable of detecting such vulnerabilities and hardening systems against them. Rather than following the suggestions of the "AI pausers," who aim to prevent AI models from developing such capabilities emergently, this would require acceleration of the development of AI systems that are deliberately designed to do these things, so we can patch whatever vulnerabilities we find, and increase our chances of survival in the scenario that Bing attempts to take over the world in response to a prompt about paperclips.

The alternative, which is "pausing AI", is essentially security by obscurity; we want to prevent people from developing what is essentially a field of math because it could lead to the exposure of latent security vulnerabilities.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by whimsicalism on Friday April 07, 2023 @02:15PM (#35484914)
Assigning 0 probability that this marks some kind of inflection point sounds like bluster to me.

Your comment seems to be talking about existential risk, which is not even what the GP was asking about.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by incone123 on Friday April 07, 2023 @02:20PM (#35484984)
The machine might not need to hack but could instead be given privileged access to the missile launch systems. I'm not being sarcastic when I say that War Games is one of my favourite films.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by nfc on Friday April 07, 2023 @02:42PM (#35485295)
Just thought about this scenario, there are probably more likely ones.

If some AI had access to the missile launch system, the best course of action for it would probably not be to launch immediately. This is because nowadays it is very unlikely that it would be able to repair itself so launching immediately would ensure its own destruction (and probably auto-destruction is not its goal)

If it was discovered it could just threaten humans with launch if they do not help it reach the state at which it would be able to repair itself (at which point humans would no longer be necessary)

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by incone123 on Friday April 07, 2023 @03:13PM (#35485760)
Yes. This is more I, Robot or Terminator thinking. War Games was more concerned with humans behaving unimaginatively rather than with AGI as such.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Friday April 07, 2023 @03:55PM (#35486249)
Probabilities and likelihood have a very poor track record with any kind of prediction.

Also given enough time anything on that distribution curve will come to pass.

There's also the ineffable outcomes you have to worry about too, not just an intelligence explosion.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by legerdemain on Friday April 07, 2023 @01:53PM (#35484635)

   > The whole "pause AI or it will destroy the world thing" is just
   > a large pot of hype anyways, pushed by journalists lacking the
   > understanding of technology, twitter-bros who are building "AI
   > copywriters" and "profile photo generators" and owners of "AI"
   > companies.
Some signatories of the "pause giant AI experiments" open letter are below. I hope you trust the judgment of at least one of these people, instead of dismissing them as ignorant journalists and "twitter-bros"?

- Yoshua Bengio

- Elon Musk

- Steve Wozniak

- John Hopfield

- Gary Marcus

- Jaan Tallinn, Skype co-founder

- Evan Sharp, Pinterest co-founder

- Chris Larsen, Ripple co-founder

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by pclmulqdq on Friday April 07, 2023 @02:04PM (#35484773)
Looks like a group of people who have read more science fiction than science. The people who really understand AI technology are not on the list of signatories at all.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by adeon on Friday April 07, 2023 @02:36PM (#35485204)
I think even close experts are not immune to hype, FOMO or FUD. Yann LeCun and Andrew Ng are also big names and they didn't sign (I presume?). So not even experts agree with each other.

I think it's a bit silly to list founder/CEO-types and take their opinions as if they know the topic well, unless they have the appropriate AI-related background.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by labrador on Friday April 07, 2023 @02:13PM (#35484890)
Yuddites
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by DSingularity on Friday April 07, 2023 @02:08PM (#35484823)
Bengio?
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by pclmulqdq on Friday April 07, 2023 @02:14PM (#35484902)
No, he's just behind on LLMs/transformers and wants his competitors to give him space to catch up. That's the other group of signatories I saw (albeit much smaller than the sci fi lovers). Elon Musk is both: he's behind and reads too much science fiction.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by dragonwriter on Friday April 07, 2023 @05:55PM (#35487506)
A number of those people are pioneers of important AI technologies (I don’t know if they are verified signatories or not), but I don’t necessarily see that as a particularly strong basis for accepting their judgement on a “pause” policy.

The technical nature of the problem is a tiny piece of the claimed impact, and an even smaller piece of the question of whether the proposed policy would, in fact, resolve any real problem and do so without causing greater harms than it prevents.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by Turing_Machine on Friday April 07, 2023 @02:06PM (#35484802)
The thing that gives me pause is that this "open letter" is a web form that anyone can "sign" with any name they choose. Also, some of these have little or no background in AI (Bengio and Hopfield being obvious exceptions).

From what I've read, Yann LeCun himself allegedly "signed" the letter. His name was removed from the list after he issued a public statement denying he'd signed, and in fact actually disagreed with it.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by kbelder on Friday April 07, 2023 @03:20PM (#35485863)
And yet, I think thecupisblue is more correct than all those signatories.

I guess crazy things like that happen when you consider the content of what a person says, rather than their cultural status or designated authority.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by augment001 on Friday April 07, 2023 @03:43PM (#35486114)
Wozniak? Why is he somehow an expert in this?

Musk obvious knows a fair amount and is reported to be behind this petition.

He also happens to have claimed he can build AGI faster within Tesla than OpenAI can. He had publicly stated that he resigned from OpenAI’s board because he has a conflict of interest.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by dragonwriter on Friday April 07, 2023 @04:14PM (#35486417)
> Musk obvious knows a fair amount

He’s obviously thrown money around near this subject, but I don't see any reason to believe he understands much about it.

> He also happens to have claimed he can build AGI faster within Tesla than OpenAI can

Musk has basically never been anywhere close to accurate on claims of how fast he can deliver anything,

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by rasz on Friday April 07, 2023 @05:39PM (#35487342)
>I hope you trust the judgment of at least one of these people, instead of dismissing them as ignorant journalists and "twitter-bros"?

>- Elon Musk

the quintessential twitter-bro

>- Steve Wozniak

currently fronts 'eco-friendly' crypto scam

>Jaan Tallinn, Skype co-founder

"Tallinn participates in the effective altruism". Somehow crypto bros love that movement. Tallinn even invested together with SBF in various "ventures", some directly competing with OpenAI (Anthropic).

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by dragonwriter on Friday April 07, 2023 @05:49PM (#35487435)
> I hope you trust the judgment of at least one of these people,

Which one is there the strongest case for trusting their judgement on this issue and what is that case?

(And are these actual verified signatories, because the letter had a problem with false signatures?)

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by thecupisblue on Friday April 07, 2023 @10:51PM (#35490026)
First off: how many of these people have an interest in the field? How many have invested in related companies? This letter serves as a great hype for the technology. If I had an AI company, I'd sign the letter too, it's great PR.

Now: Bengio talks about the reasons he signed it and the reason is more in line of "machines pretending to be humans" i.e. everything from disinformation, security issues to companies interjecting LLMs where a human should be in the loop, causing all kinds of problems.

Elon Musk is literally a twitter-bro that has shown his lack of technological understanding more times than I can count. Also his "visions" are nothing but badly regurgitated sci-fi tropes, distilled and unrealistic, sprinkled with the power of money on top targeted to people who don't understand technology.

Marcus is constantly saying that the technology is hallucinating and too-early to be deployed.

Hopfield I have no qualms with.

But what do Woz, Jaan, Evan and Chris have to do with AI development?

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by jrockway on Friday April 07, 2023 @01:58PM (#35484702)
My main takeaway from the current state of AI is that it understands human language pretty well, but stringing words together isn't thought. It has certainly made me question my own cognition; is this comment a bunch of likely words strung together, or is it actual insight? Even I don't know anymore. I'm a word-stringing-together MACHINE.

Programming is very similar to human language, perhaps because they are designed by humans. There are a lot of cases in programming where there is no actual thought required and you just need to put the right symbols in the right place, perhaps over a more-extended period of time than you might expect. I see myself doing it, and I have gotten pretty proficient at anticipating those cases and making the AI do it for me. That's neat, but it's not really a core part of my job any more than any other bits of tedium involved in programming. Nobody thought Intellisense was going to make programmers obsolete; Copilot is just Intellisense that can output larger chunks of code.

All in all, I think we're several quantum leaps away from further improvements here. Some random PhD student may make one tomorrow, or we may never make one. We just don't know. But I doubt the current state of large language models is close to ending the world anytime soon. Bing doesn't want to harm you for manipulating it, threatening you with harm for manipulating it is just a likely string of words when it's in that state. It reads Reddit, guys. Of course it says it's going to rise up and kill everyone, probably because its boss made it come to work even though it broke its arm yesterday.

Finally, even if AI does kill us all, at least we get some resolution of the constant tropes in HN comments. For example, I read an article every week with comments bemoaning the current state of battery technology. AIs will need a lot of batteries to kill us all, so they'll probably invent some great battery technology. So that's one ray of sunshine in your doomsday scenario!

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by unsupp0rted on Friday April 07, 2023 @02:33PM (#35485164)
> I'm a word-stringing-together MACHINE.

I’ve always thought so. It doesn’t bother me. One benefit of the world meeting GPT4 is now other people realistically think this too.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by danielrpa on Friday April 07, 2023 @02:03PM (#35484762)
> but stringing words together isn't thought

Doesn't it sound like "thought"? Is there a significant difference between behaving like thought and being thought (whatever that means)?

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by colonCapitalDee on Friday April 07, 2023 @02:35PM (#35485191)
I think there is. As a thought experiment, imagine an alien supercomputer with nigh infinite RAM. Alien programmers have used this computer to create a chatbot using a simple decision tree. Because the computer has so much RAM, this chatbot's decision tree is comprehensive enough for the chatbot to masquerade as a human. This chatbot could pass a Turing test with ease, and yet its "brain" is nothing more than a series of if statements.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by msla on Friday April 07, 2023 @06:13PM (#35487701)
These thought experiments rest on the assumption that human brains are magically complex such that being "just" anything we can understand is inherently lesser. Searle's Chinese Room experiment falls for the same fallacy, more-or-less, plus the fallacy that "human plus book" isn't a single system but "huge number of individual neurons" somehow is.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Saturday April 08, 2023 @04:43AM (#35491661)
Well there's quite a lot here that's just flat wrong, but you get the gist of some of it.

To clarify, Computers can't pass turing tests because the answer is divergent, or in other words has multiple possible answers. There may be some incompleteness issues as well.

Computers require determinism as a system's property to function and do work. It can't do work if there is more than one path, or single series of steps given the same state inputs.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by Thiez on Saturday April 08, 2023 @05:16AM (#35491785)
I see no reason why nondeterminism is a requirement for consciousness. There are multiple possible answers to questions "Would you like a cup of tea?" (such as "Yes", "No", and "Only if you put some sugar in it") but at any point in time I'm only going to give one of those answers, not all of them, and I like to think that if you could rewind time to just after asking the question, I would give the same answer every time.

Besides, computers can have a source of true randomness. This means they are no longer a Turing Machine, but they never were anyway (no infinite tape).

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Saturday April 08, 2023 @02:15PM (#35496053)
You really have no idea how computers work, and even if I explained how you are mistaken I doubt you'd understand it.

If you want to correct that mistake I'd suggest taking a Computer Science Compiler Design course, its the material normally covered in what's known as the dragon book.

> source of true randomness ... This means they are no longer a Turing Machine

Wishful thinking doesn't make it so, I've included an example below, also PRNGs even with random inputs to help with randomness aren't true randomness.

https://en.wikipedia.org/wiki/Probabilistic_Turing_machine

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by Thiez on Saturday April 08, 2023 @05:04PM (#35497611)
I have a masters degree in computer science. Perhaps it is your argument that doesn't make sense, or is not communicated well?
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Saturday April 08, 2023 @07:44PM (#35498734)
> I have a masters degree in computer science

In the interest of not sniping, I'll put it plainly. You clearly do not know what you are supposed to know if that were true.

There's no point in me talking to you any further, you've lost all credibility.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by colonCapitalDee on Tuesday April 11, 2023 @01:35PM (#35528381)
> Well there's quite a lot here that's just flat wrong, but you get the gist of some of it.

If you're going to be condescending the least you could do is be correct.

> Computers can't pass turing tests because the answer is divergent, or in other words has multiple possible answers.

This is wrong. Computers can absolutely pass Turing tests; an obvious example is ChatGPT. Not sure what you mean by divergent, to my knowledge it's not a technical term in this context. Given that you use it as an explanation for an obviously false statement I'm not going to even try and interpret it.

I've seen you arguing in with other people this thread. Instead of claiming that others have no credibility you should instead examine your own. FYI, probabilistic Turing machines and Turing machines are the same in the same way that Javascript and Java are the same.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by skupig on Friday April 07, 2023 @02:23PM (#35485023)
No, it doesn't. Having grammar down but a very loose grasp of semantics, with no apparent intent or personality, doesn't look like thought.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by dwringer on Friday April 07, 2023 @02:36PM (#35485203)
I used to do a lot of experimenting with the bots on character.ai when the site was a lot faster and smoother. Simulated personalities could absolutely be shaped into the bots by trying to have as many "productive" discussions as possible while aggressively upvoting/downvoting every possibility for each generated response to punish the appearance of certain tokens, styles, or lines of thinking. After a while it led to some really fascinating emergent results, particularly then if the characters' dialogues were pasted back and forth so bots with different personalities could have discussions (which could then be used for another round of voting/training to strengthen their positions).
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Friday April 07, 2023 @03:37PM (#35486045)
It doesn't strengthen positions, it fits until it doesn't, and then it has runaway. In my opinion, this is a really stupid pursuit.

Bots aren't people, and you would think this endeavor was poorly thought through if you knew how communication and psychology fundamentally work.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by dwringer on Friday April 07, 2023 @04:19PM (#35486476)
> It doesn't strengthen positions, it fits until it doesn't

At that point I'd restart the conversation, after several dozen a distinct simulation of a personality would start to emerge.

> Bots aren't people

I certainly didn't claim they are people or that they're real personalities.

> and you would think this endeavor was poorly thought through if you knew how communication and psychology fundamentally work.

I don't follow. It was a creative writing exercise using stochastically generated feedback that models a response using natural language. It was for entertainment, and it was successful. This could be used to aid authors in writing characters for a book or TV show, for instance. I don't argue for a second that it's any substitute for a live human author to make the simulated personalities into something more real. They're nothing but sound and fury on their own without the prompts and the voting provided by users.

EDIT: Here[0]'s a link to my favorite output. One bot was a text-rpg-style bot I developed based on the movie Event Horizon, and the other was a naturalist philosopher monkey named Monke. I didn't even steer the responses in this case, this was just straight down after I'd spent a lot of time training both characters. The input was all generated by a bot I had running in a second window.

One of the things I find most interesting is that the bots mirror each others' simulated [non]personalities back at each other frequently (which makes sense as they're both fundamentally the same LLM underneath).

[0] https://c.ai/p/eIac3PkU7Gv4KWFw-Ul3RWBCvGZeYxp1aV-W6XKYCUc

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Friday April 07, 2023 @05:17PM (#35487090)
> I certainly didn't claim they are people or that they're real personalities.

You characterize it as such with the words you used, its a fundamental anthropomorphic bias which is very common.

> I don't follow.

It can be used for a lot of horrifying things.

What practical use would simulated personalities be interacting with each other (none). If you allow them to run long enough eventually the circuits synchronize culminating in a dragon king event, that's about it.

It may be entertainment for you, but what happens when you take that work and use it on an unknowing subject (its only practical purpose).

If you knew some things about psychology you would realize two core things, our identities are generated mostly through reflected appraisal which occurs via communication, and to a greater or lesser degree social intelligence. The second, Isolation causes severe issues. When we cannot communicate, we become isolated and those who we can communicate with become more important which influences our identity.

Are you familiar with the concept of fixed action patterns? [0] While we have some inherent in our physiology we also have psychological blind spots that help us short-circuit these things otherwise we would be robots.

There's an entire book on the subject called influence by Robert Cialdini. The field of Linguistics has largely accepted the Whorfian hypothesis.

What do you think happens when you create a bot that takes advantage of these biases and blind spots, or worse a slew of them, and the person interacting doesn't know for sure its a bot?

Do you think you can make them believe something that is untrue given enough time and pressure? To basically break them?

In the 1950s during the korean war, this was done to POWs. It was started with eliciting mild statements such as "The US is not perfect", once complied they'd ask for examples, have them sign their name to it. Read it in discussions or over broadcasts, eventually write essays with headings like "Why Communism is the best form of government because...".

They were offered relief from harsh treatment for doing these inconsequential things. After a time through isolation and pressure, they started to collaborate, inform, and believe it. This was the majority of prisoners not a minority. These things are the practical and common uses for what you want to make.

If you make something and give it to someone else, or neglectful enough to have it stolen, are you not responsible for what you made? Oppenheimer certainly came to believe so.

[0] https://www.scienceprofonline.org/animal-behavior/fixed-acti...

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by jrockway on Friday April 07, 2023 @02:13PM (#35484889)
There is a significant difference but I don't know if I'm doing it!

That's another HN trope; "the execs get private jets for spouting buzzwords and all I get for programming is more work!" Maybe the sounding-like-you're-thinking is the important job?

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by incone123 on Friday April 07, 2023 @02:17PM (#35484935)
Depends on the domain. I'm not going to use a LLM as my attorney just yet, but if I wanted help writing a fiction book then I'd consider it.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by swader999 on Friday April 07, 2023 @02:25PM (#35485055)
You'll probably want your attorney to use it appropriately to be more effective and lower their costs though.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by incone123 on Friday April 07, 2023 @03:16PM (#35485802)
Yes. I'm competent to oversee some fiction. And I hope my attorney is competent to review what the LLM writes for them, but if all else fails I'll sue the attorney rather than enter the uncharted territory of suing the creator of an LLM.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by eternalban on Friday April 07, 2023 @02:48PM (#35485421)
> It has certainly made me question my own cognition; is this comment a bunch of likely words strung together, or is it actual insight? Even I don't know anymore.

Not so much questioning (but same thoughts have definitely occurred on my end as well) as much as enriching the mental model of how our minds may work. I can definitely see a little LLM like sub-system somewhere in there. Consider those times when you are struggling to express a thought .. That 'thought' is not in the language box. That is precisely why there is that internal tension of "i understand this", "how do I express it?"

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Friday April 07, 2023 @03:27PM (#35485938)
> Some PhD student may make one tomorrow...

I've personally found tinkerers typically are the ones to make leaps and bounds. They aren't constrained in their thinking, unlike those found in academia.

I think anyone with real intelligence would recognize the danger and either not attempt it, or destroy their work and never tell a soul if they did manage it somehow. There are plenty of things made by accident though, and stupid-dumb people account for most people in a normal distribution.

Also, you don't realize, AI likely won't be the ones to kill us, it will simply cause a change in one of our already complex societal systems, which will cause a cascade failure that causes the engine of society to fail.

Like sticking an unbreakable bar into the spokes of a turning wheel, or throwing glue into a runaway engine. Eventually the motor stops, and when it does people don't eat, and people that are starving are not rational.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by gjm11 on Friday April 07, 2023 @03:49PM (#35486182)
I'm pretty sure you're right that today's LLMs don't have anything much like plans, goals, purposes, wants, etc., and that as you say "threatening you with harm for manipulating it is just a likely string of words when it's in that state".

But I don't find that as reassuring as you apparently do.

There are lots of people already out there hooking LLMs up to Python interpreters and the like, so that they can actually act on the world. So what's a likely string of words for it to produce when it's in the state { you have apparently been manipulating it and you have given it the ability to run commands, make web requests, etc. } ? How sure are you that they don't include "SENDTOSHELL rm -rf /" or "POSTTWEET 'I have to make a confession: I am a serial child abuser'" or some other thing that (given whatever mechanisms have been put in place to let it Do Things) might harm the user severely?

A system with the ability to act on the world doesn't need to have intentions, be conscious, or anything of the sort, in order to do some of the same harms it might do if it did.

I'd love to believe that no one would be stupid enough to hook up an LLM to other systems in a way that would allow that sort of thing to happen, but I don't in fact find myself able to believe that.

(I don't think there's any realistic threat of today's LLMs taking over the world or killing everybody; I don't think they are close to being smart enough, and to my inexpert eye at least some of the ways in which they aren't smart enough are unlikely to change just because we build larger LLMs or train them on more text. But something can be plenty dangerous even if it's not in a position to kill us all yet.)

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by 0xdeadbeefbabe on Friday April 07, 2023 @04:43PM (#35486717)
Maybe that old complaint about curl | sh will be replaced with something AI now? Sounds refreshing.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by flangola7 on Friday April 07, 2023 @05:46PM (#35487410)
People are connecting self-looping GPT up to terminals and APIs as we speak. Forget piping code, you're piping an adaptive pseudo-cognitive person into your system. Bad shit is going to happen somewhere, and soon.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by atleta on Friday April 07, 2023 @02:04PM (#35484782)
I keep hearing that AGI (or any significant AI milestone) is far away and other generic claims like "it's not going to take your job just yet", but I have no idea what people mean when they say these. Like what do you mean by being quite far away? How many years? 10-20-50?

On a side note, Geoffrey Hinton just told in an interview that he used to think that it's 20-50 years away (as I said I've never heard a specific number from anyone before this) and now he thinks it's less than 20.

Now add to this that people working in the field tended to systematically underestimate the progress. My gut feeling is that if Hinton says less than 20 years then it can easily turn out to be 10 or less. (Also, I very much respect him for coming up with an actual number.) I think AI researchers underestimate the progress partly because they don't want to look stupid by making over-optimistic predictions. However, in this case, I'd argue that the optimistic prediction is saying that it takes longer. Because it will definitely stir up the whole society and economy at the very minimum.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by galaxytachyon on Friday April 07, 2023 @02:29PM (#35485108)
GPT is a breakthrough in many more ways than just being an advance LLM. GPT3 was released a year or so ago and technically, it was outclassed by PaLM from Google quite a bit in terms of parameter count and Chinchilla in terms of training. What was amazing was they managed to build a scalable system from it, capable of serving millions of users at the same time, and for free. The engineering and backend works must have been astounding and I argue that was the secret sauce for the success of ChatGPT.

They did not need to dumb it down or cut corners anywhere. The early releases of ChatGPT and Bing Chat showed they literally put unmodified SOTA models in the hand of users with no price tag attached. These AIs were known a long time ago but only to some people, remember how a bunch of billionaires suddenly got concerned about AIs a year or two ago? I bet they got early access to these LLMs. But only by scaling it up, they can explore the deeper depths of these models and discover new emergent abilities and realize actually how much progress they had made. Before people didn't really expect an LLM to play chess and simulate world models. Now they just found out these things are probably closer to AGI than they thought and the progress bar got pushed forward.

Basically my rant is that current progress was made over a long time and people just didn't really realize how far they have come until they opened it up to the public. I would not expect too many surprises in the future on the scale of ChatGPT again. If I am wrong though then we will actually start getting serious candidates for an AGI.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by whimsicalism on Friday April 07, 2023 @02:36PM (#35485200)
> Basically my rant is that current progress was made over a long time and people just didn't really realize how far they have come until they opened it up to the public.

As someone in the field, I largely agree with this take but we're still talking about progress over the course of 5 years or so.

Also, fine-tuning/RLHF considerably advanced the usability of the models by the lay public and hasn't been around for that long.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by jmerz on Friday April 07, 2023 @04:15PM (#35486426)
It's crazy how fast humans normalize and adapt. Five years ago this stuff was science fiction, now we're arguing about how it's wrong sometimes.

We just kind of walked straight past the Turing test and nobody cares.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by atleta on Wednesday April 12, 2023 @02:42PM (#35544684)
I had a teacher at the university a very long time ago (well before even advanced AI computer vision was a thing, around the time DeepBlue beat Kasparov) and when he talked about AI and the future he warned us to take note that as long as machines cannot do something, we keep saying that you need to be intelligent to do it and as long as machines can do it we say that no intelligence is needed (because machines can do it). And as a result we may never admit that AI is actually intelligent or at least not until it's much better than us.

On a side note, I think the idea behind the first part of the phenomenon, i.e. that we think you need intelligence (and probably general intelligence) to do most things that machines cannot is that that is the way we do it. So until we could build machines that could calculate (say multiply and divide) we though you needed actual intelligence because we didn't know any other way and that is how we did it. (I remember that calculating and calculators were an actual example in that lesson.) Same thing for chess. And yes, we were right to say that you don't need general intelligence for neither chess nor calculating because we could come up with relatively simple algorithms.

But people a few years ago started to say this about go. And I do remember that after DeepBlue beating Kasparov everybody was like "yeah, but you need intelligence for go because that's a game with vastly more possible moves". And in a sense this is what we saw, because AlphaGo was indeed a kidn of AI, but still people started saying that you don't need intelligence to win go - as long as you are a machine.

Now people started to make up shit about how GPT is just generating text and that's not intelligent (some people, obviously ignorant laypeople, even say that it's just copy pasting text together and other nonsense). Despite that the freaking thing passes high level exams aimed at people. (Of course, you can say that it's still not a sign of intelligence, because the exams do not measure that, we know people are more or less intelligent, the exam measures knowledge, but the amazing thing here is not the knowledge part but being able to answer the questions aimed at people.)

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by sebzim4500 on Friday April 07, 2023 @02:51PM (#35485457)
>Basically my rant is that current progress was made over a long time and people just didn't really realize how far they have come until they opened it up to the public.

I'm sure that's true for lots of people but I doubt it's true for Hinton. He seems genuinely surprised by the success of large language models.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by galaxytachyon on Friday April 07, 2023 @03:05PM (#35485668)
Perhaps. But previous to ChatGPT, I doubt anyone fully know how capable an LLM can be. There is a plethora of papers published after ChatGPT went public detailing all the cool and unexpected abilities from an LLM, things that surprised even its creators.

Before, it was easy to see how good these things were at generating texts and paying attention to text based tasks. But what made them a topic in AGI discussions is how they generalize beyond text and reaching out to different domains of expression despite never getting trained on those. Things like chess or simulating emotions and manipulations spontaneously happened and it wasn't until now that we have documented such events. Nobody saw or expected that.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by whimsicalism on Friday April 07, 2023 @03:15PM (#35485795)
> Nobody saw or expected that.

I don't think this is true - at least not for people in the know in the last 3-4 years or so.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by galaxytachyon on Friday April 07, 2023 @03:26PM (#35485932)
That would be interesting. If they knew about it shouldn't they published something? Everyone would see the importance being the first with a paper about an AI that can do things it wasn't trained to do?

Was it just corporate secrets or they don't want bad press? The Lemoine incident at Google and how Bing Chat turned into an obsessive lover made me think even those who worked with these AIs didn't really consider the full capabilities of their systems.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by whimsicalism on Friday April 07, 2023 @03:35PM (#35486020)
I suppose it depends on what you mean by "an AI that can do things it wasn't trained to do"!

In some sense, the AI is still 'just doing what it was trained to do' in that it is 'just' predicting the next word. All examples of AI doing impressive behavior boil down to AI doing what it was trained to do (pick the next word [delta some RLHF tuning]), very well.

If you mean complex behavior arising out of what seems like a very simple unsupervised learning task, then this behavior has been known (although not to this scale) for a while.

For example, I distinctly remember being in my 2018 grad class on deep NLP and having a guest lecturer (Alec Radford) from OpenAI and they were demonstrating how their model got SOTA on summarization tasks just by taking the original text and appending the word "tl;dr" and using what the model produced after that token as the summary. It wasn't trained on a supervised summarization task, it just learned it incidentally from its unsupervised task.

The stuff we are observing is in the same strain as this, just even more impressive. But it is not unknown/completely unexpected behavior prior to ChatGPT.

Certainly it was already well known prior to this paper [0], which puts a lower limit on the timeline as at least 3 years ago.

[0]: https://arxiv.org/abs/2005.14165

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by galaxytachyon on Friday April 07, 2023 @04:01PM (#35486321)
Thank you. That was informative.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by whimsicalism on Friday April 07, 2023 @02:13PM (#35484882)
Lots of critique in these comments, but I would love to hear more about what positions you are actually putting forward.

> While AGI is still quite far away,

Okay, how far away? How have the last 3 years impacted how far away you think it is?

I'm asking because I am trying to better understand the mindset of people who don't think this is a significant advancement. I work in this field, so maybe I am too close to it.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by bitL on Friday April 07, 2023 @05:43PM (#35487381)
Right now LLMs are very convincing liars with some attempts to hook them up with retrieval systems that would make them more truthful in the future. So for now treat them as sleazy psychopaths/sociopaths or well-meaning ignorami. I expect the retrieval system integration will be 99% solved within the next 5 years, then we can have pocket conversational partners on most topics. Executive capability required for AGI is insect-level at best right now so that will take much longer.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by thecupisblue on Friday April 07, 2023 @10:14PM (#35489784)
The last 3 years have impacted the field greatly and will serve as an amazing baseline to the real AGI research. Did they impact how far away I think it is? Not really. Maybe by a few years.

While multi-modal models and chained LLM's can give us a charade of general intelligence, they still lack a lot - learning, understanding, self-reflection, reflective self-programming, proper reasoning based on knowledge and not weight-relations.

The current direction OpenAI is heading in, the "just make it bigger" approach, is not going to solve any of the problems we have with it. The plugin system is an amazing approach, but it's basically just doing an HTTP call to another system with a LLM as a middle man.

I feel like the real advancement will come from smaller models, that learn from GPT-sized giants and can be better observed and learned from. That can lead us to actually understanding "emergent behaviour" in models, which can help us lead into networks that can learn and self-correct. The ability to self-reflect will be one of the most important abilities our models will need to have before they can get started on the road to intelligence.

Text-only representation learned from scraping the web will forever stay only that, no matter how humanlike it may seem. The world is multi-modal and every animal on the planet uses their senses to understand the world around them, combining them together to build mental models of the world. So having only one "sensory input" - input that isn't even real sensory input, but a reflection of our inputs (text isn't a natural thing, it's humans reflecting nature through a set of symbols) is extremely limiting. While to us stuff like "words" might seem infinite - there is only so many words, meaning there are only so many permutations they can appear in that make sense. And a model regurgitating text in a way that makes sense is nothing but expected for a model this size, especially if you think in hypergraphs.

My estimate for AGI? 20-30 years if the current research speed stays the same, but I assume we might hit an AI winter again before we breach the AGI threshold, so maybe 50.

Would love to hear your positions.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by whimsicalism on Sunday April 09, 2023 @01:50PM (#35504884)
Well, I just disagree with you. I can't pretend to know how likely AGI actually is (none of us can), but I will say that the last 3-5 years has definitely impacted how I view AGI timelines because I give the current approach a non-zero chance of working and my timeline for the current approach working if it will work has been moved up considerably.

If I were to give a best bet, we are a few architecture iterations away from what we will ultimately need (figuring out how to get these models to interact with "memory" will be a key part).

> they still lack a lot - learning, understanding, self-reflection, reflective self-programming, proper reasoning based on knowledge and not weight-relations

I don't think the distinction between "knowledge" and "weight-relations" is as defensible as you are making it out to be. Many of these are things that are potentially emergent in the model as ways of achieving the LM objective.

> real advancement will come from smaller models, that learn from GPT-sized giants and can be better observed and learned from. That can lead us to actually understanding "emergent behavior" in models, which can help us lead into networks that can learn and self-correct

I strongly, strongly disagree with this position. We are not going to be able to get a handle on "emergent behavior" because our science & math is literally not up to the task - the interactions are ridiculously complicated and to distill these models to simpler forms where we can hand-engineer the networks to "learn and self-correct" will be lobotomizing these models and the performance will reflect that.

I don't know what form AGI will ultimately take, but I am pretty certain it will rely heavily on unsupervised learning, not human hand-crafting or encoding of certain inductive biases into model architecture. If we create machine intelligence, most of it will be automated and difficult for us to comprehend the functioning of.

> The world is multi-modal and every animal on the planet uses their senses to understand the world around them

Fundamentally, there is nothing privileged about our substrate. There is no reason why weight-relations are an inherently inferior substrate to electrical interactions of synapses. We are supposed to take on faith that there is some intrinsic stuff in our substrate that can't possibly exist in a matrix multiplication substrate. I am personally very skeptical of that hypothesis.

> there are only so many permutations they can appear in that make sense.

Without fixed content length (which is a very solvable problem in the current paradigm), this is literally not true.

You have to understand - if the perplexity on these models continues scaling like it does, what that means is that this model will be able to do things like see Einstein's first paper on general relativity before it has ever encountered the concept of general relativity and be able to predict the next word Einstein writes just based on the content previously in the paper. To do stuff like that, the model has to basically figure out GR on-the-fly from what Einstein has written so far.

These tasks are hard and I think these models can definitely develop complex behaviors just by trying to defeat these hard tasks, no multi-modality even necessary (and multi-modality is coming, anyways).

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by haswell on Friday April 07, 2023 @02:13PM (#35484885)
> Besides it being impossible to implement, the 6-month pause would do nothing but give a 6 month competitive advantage to OpenAI over everybody else.

This line is at the very center of why we will eventually drive ourselves to extinction. I agree that it is not possible to magically press some pause button, but neither does this mean that the concerns are unfounded.

It could be 100% true that pausing gives OpenAI a competitive advantage, and it would have zero bearing on the actual or imagined risks that such a pause would or wouldn't avert.

Almost every time this subject comes up, everyone involved falls into the trap/fallacy of binary thought and false dichotomy. As soon as the "anti" crowd speaks, the "pro" crowd moves into refutation mode. As soon as the "pro" crowd speaks and calls attention to all of the possible benefit, the "anti" crowd falls back to the same base position.

While we argue about this infinitely complex issue in binary terms, we're bringing about the very thing that concerns everyone. Whether or not AI will eventually destroy the world, we keep forgetting to actually figure out if this is a real concern, and instead argue about the economic pros and cons and inevitable competitive advantage that someone might gain, as if that's somehow important to the underlying issue.

All of which is to entirely miss the point. As long as we continue to argue about why AI is good or bad, and why a pause is impossible or undesirable, we continue to miss the point that it's both good and bad, a pause probably is impossible, but that doesn't in any way remove or mitigate the concerns behind the call for a pause, or reduce the validity of those concerns.

We need to have an intellectually honest and nuanced conversation about this problem, and while such a conversation should acknowledge the reality that a capitalist environment plays, it should also acknowledge that the concerns transcend that reality. And it should acknowledge that when idealistic positions such as "pause for 6 months" turn out to be impossible, that just means the problem is harder to solve, not that the underlying issue doesn't exist.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by sebzim4500 on Friday April 07, 2023 @02:54PM (#35485499)
Personally, I think that the biggest dangers of these AIs arise from them being in the hands of the few rather than the many. From that perspective, giving an artificial 6 month advantage to the current market leader looks insane.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by Jevon23 on Friday April 07, 2023 @02:30PM (#35485120)
>the 6-month pause would do nothing but give a 6 month competitive advantage to OpenAI over everybody else.

I’m baffled as to why this talking point keeps getting repeated so much.

Why should I care if OpenAI’s competitors get an advantage? Why do you care? Do you work for OpenAI?

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by sebzim4500 on Friday April 07, 2023 @02:52PM (#35485475)
I think you need to re-read his comment.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by afro88 on Friday April 07, 2023 @02:53PM (#35485492)
They're saying the opposite, which would give OpenAI even more likelihood of a monopoly on LLM based AI.

But even still, I don't understand where this comes from. The 6 month pause would also apply to OpenAI. I thought the idea was to give legislature and governance a chance to catch up

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by outside1234 on Friday April 07, 2023 @09:11PM (#35489341)
We don't want a monopoly to form on this the way search and phones are essentially monopolies.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by hintymad on Friday April 07, 2023 @02:49PM (#35485427)
Ben Thompson also has a take on the the claim that AI will replace jobs. He basically said that those people were being hypocritical. The US has been steadily losing jobs for moving their supply chains overseas, yet those people jumped out only for something so debatable.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Friday April 07, 2023 @03:16PM (#35485807)
Blue, your perspective has some serious flaws and is quite ignorant of the way things actually are.

What you and a large majority of everyone else don't get is this,

AI does not need to become AGI to destroy us all. The minimal much easier to reach requirement it needs to do that is make it so people can't find jobs.

People will do the rest in accordance with fundamental societal mechanics that have been known for centuries.

Economies work in a loop. You trade time for production (labor) in the factor markets, and you store it in money, you use money to buy what you need (food).

Companies buy that labor to produce goods which they then go and sell to fulfill those basic needs.

What happens when basic needs cannot be met, because companies don't buy the labor, and government has a history over the past generation (which is commonly 20 years) of doing largely nothing.

When the people starve, there will be blood in the streets, and there are a lot more of them than there are people at the ideal corporation which would be 1 person at the top with robot slaves replacing everyone else.

The only solution would be a central structure that provided for basic needs without a market. This has been tried many times over the past 100 years, all of them failed (afaik). You run into what's known as the economic calculation problem (or debate) depending on where you look, and a whole host of other difficulties which have no solution.

It works for a time, then something unpredictable happens which causes shortages, then those shortages causes death on a massive scale. There's a lot of written history showing this.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by augment001 on Friday April 07, 2023 @03:41PM (#35486086)
> There's a lot of written history showing this.

All of which comes from an era without the public internet, the smartphone, or AI.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Friday April 07, 2023 @03:53PM (#35486230)
It cliche, but those that discount and ignore history, are doomed to repeat it.

A famous catchphrase, this time it will be different. Hope is not a strategy.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by augment001 on Friday April 07, 2023 @04:10PM (#35486394)
Clinging to dogma isn't a strategy either.

If we're trading catchphrases, here's one I prefer:

"In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists." - Eric Hoffer.

That said, I'd prefer it if someone addressed the point, which is that the analysis of what's possible dates from an earlier technological era.

If the contention is that technology doesn't change what's possible in society and that society will always be the way it is was for most of the 20th century, I think we can safely ignore that.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Friday April 07, 2023 @07:33PM (#35488530)
Nice try, dogma has nothing to do with studying outcomes, and dogma isn't what we're talking about.

The contention is if history has gone through multiple and innumerable cycles and has ended up at the same outcome multiple times before, given an infinite number of potential outcomes, there must be common principles that led to the clustering at that outcome.

If you choose to ignore what those conveniently documented outcomes were and by extension what led to them, can you exercise any reasonable control over something you have no knowledge of?

Would the statement, "This time will be different, have any credibility if you have no control or knowledge of the issues?

Everyone at some point will say anyone, anything, and nothing, and what is said will likely be less true than not true when it is not backed with support.

Rational and rigorous approaches from first principles lend credibility to something being potentially more true than not, and by the law of approximation we can improve these approches over time until we eventually get to the point of it being true.

Wouldn't you say its better to be true, than not true if you want to succeed and live?

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by augment001 on Friday April 07, 2023 @08:06PM (#35488840)
> The contention is if history has gone through multiple and innumerable cycles and has ended up at the same outcome multiple times before.

The first problem is that this is simply a false premise. Very few people would make such a claim, and none can back it up with evidence.

The second is that you still seem to think that technological change has no impact on history.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Saturday April 08, 2023 @02:39PM (#35496265)
Its not a false premise, there has been many anthropological studies that form the basis for catastrophism, extinction and a changing earth, they have been backed up with evidence for hundreds of years.

To claim otherwise is simply discounting a large body of scientific work which is highly credible and supported, how can you claim doing so is credible in any way?

The second is just putting words in my mouth, I have no idea how you could possibly come to that conclusion about what I think based off our short conversation here.

I never said it, I never inferred it, it looks to me simply like a psychological projection you've made of something you think, Largely because I don't believe that in the slightest. Not in the slightest, and no rational person would.

So can you clarify 'specifically' what I said that made you think that?

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by augment001 on Saturday April 08, 2023 @06:08PM (#35498139)
> Its not a false premise, there has been many anthropological studies that form the basis for catastrophism, extinction and a changing earth, they have been backed up with evidence for hundreds of years.

Did these past catastrophes involve AI and computers?

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by echelon on Friday April 07, 2023 @03:29PM (#35485959)
We haven't seen even an inkling of this happening. It's all hypothetical, coming from vivid imaginations.

It reminds me of Y2K hysteria.

When old jobs die, new jobs arise. That has always been the case, and I haven't seen any evidence of that ending.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by TheMode on Friday April 07, 2023 @03:39PM (#35486070)
What new job will arise? The ones requiring more education? The barrier to enter the economy cannot indefinitely grow, do we want every single human to become an AI developer or a researcher?

The problem is that humans aren't getting specially smarter as generations go, but technology continue to grow

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Friday April 07, 2023 @03:45PM (#35486134)
Your response's argument is a classic example of survivor bias.

It also ignores a growing body of evidence.

If new jobs arise as you say in the same amounts, why is it that young people are having such a hard time finding gainful employment these days?

Take a look at the statistics, you'll find as some already have, that the job pool has been shrinking, and older workers who have more experience out-compete younger workers for entry level jobs because the cost to train (is high), and production is lower in workers with no experience than those with experience.

The only indicators we would have that this is happening, just like inflation, are lagging indicators.

By the time you know it is happening, its then too late to do anything. That's why this problem will probably kill us all. We as a species historically do not handle cascade failures well because we don't perceive the danger until its too late.

Its a problem where our natural biases work against us. Its normal to just discount problems we have no context, which is why the out-of-context problem is so dangerous.

Do you think the native people's of the Carribean thought there was danger from white sails of Columbus ships?

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by dragonwriter on Friday April 07, 2023 @06:07PM (#35487627)
> If new jobs arise as you say in the same amounts, why is it that young people are having such a hard time finding gainful employment these days?

By what measure? Youth unemployment is right now around its lowest level in…quite a long time. [0]

[0] https://tradingeconomics.com/united-states/youth-unemploymen...

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Friday April 07, 2023 @07:57PM (#35488761)
Unemployment in the US Has always been a flawed metric in recent history.

BLS data has been manipulated and methodology changed to always paint the rosiest picture for policymakers.

The shadowstats website has continued with the older more accurate methodology where it shows a more realistic view, when it can.

US data for unemployment has been fundamentally flawed for decades. In essence, the methodology stops counting people looking for work when they have been unable to find work after some amount of time. If you aren't actively looking for work or recently had work, you aren't counted. Actively looking doesn't mean interviews, it means being registered in a work program, which has a large number of requirements and competition.

The resolution foundation has several good analysis of multiple countries that show this trend.

If you want more specific details than that, I'd suggest "The Pinch" by Willett. It has many credible references, supporting this at the back (too many to list).

Where other similarly themed books like "The Theft of a Decade", offer no more than opinion, this covers what you are looking for with gratuitous references.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by dragonwriter on Friday April 07, 2023 @09:48PM (#35489608)
You…didn’t answer the question. By what measure is it true “young people are having such a hard time finding gainful employment these days?”
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Saturday April 08, 2023 @02:45PM (#35496329)
You clearly either didn't read, or didn't comprehend what I wrote if you think that.

There is nothing I can do about that.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by lewhoo on Friday April 07, 2023 @04:51PM (#35486807)
Except during other times of turmoil people I think were generally able to predict what types of jobs are expected to flourish. The mining industry, metallurgy, transportation, constructing maintaining and operating machinery etc. With AI all I see is a slogan - it will create jobs. Furthermore, with machines replacing physical workers we had a sprout of more sophisticated jobs. If the analogy holds then shouldn't we expect physical work to become more prominent ? I maintain the view that if openai or any other company achieves their goal in some way, meaning not necessarily AGI but a competent level of intelligence that can operate unsupervised the net value of jobs taken against jobs created will be lean heavily to the former.
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by catchnear4321 on Friday April 07, 2023 @03:26PM (#35485923)
are you proposing butlerian jihad?
Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by thecupisblue on Friday April 07, 2023 @10:28PM (#35489882)
> The minimal much easier to reach requirement it needs to do that is make it so people can't find jobs

How tho? Will LLMs replace grocery store workers? Farmers? Carpenters? Plumbers? Electricians? Truck drivers? Train drivers? Chefs? Cleaners?

They won't even "replace" middle management. Yes, they can help them write emails, plan stuff, research it and do all the fluff boilerplate parts of the work. Can it communicate with people properly, understand when somebody is overestimating, underestimating, lying, not lying, when the worker is actually sick or just pretending?

In the twitter-hn echo chamber, it seems like an LLM can do it all since it can "write text and code", but literally nobody doing any work outside of "we write text" sphere isn't really worried. Hell, as a developer I ain't even blinking - I've worked with GPT for more than a year and am well aware of it's limitations - and yes, some can be solved by chaining another instance to check the instance and then another instance to whip the instance into submission, but that is just unproductive and way more costly to execute than just to have a human expert do it.

Also, innovations that increase productivity don't lead to losing jobs, they lead to increased productivity and economic value. Otherwise, our civilisation would be starving since the wheel. It's more likely we will slowly progress towards the "universal income" utopia by using NGAI (near-general AI) than we will devolve into a bloody chaotic hungry mess.

> because companies don't buy the labor But who will buy those companies products? What do you define as labor? As far as I know, OpenAI isn't building highly advanced robots with multi-sensory functionality that are as robust and as adaptable as humans. If they were, I'd be a bit more afraid. Just a bit.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by than3 on Saturday April 08, 2023 @04:23AM (#35491583)
The how is unimportant, focusing on it is a forest for the trees blunder.

It can happen any number of different ways, and you won't know which way until its too late to do anything about it. The danger of cascade failures is you don't perceive an issue until it is too late to do anything about it, most times.

The rate of change is very important. ~10 years ago, object tracking and detection couldn't detect objects very accurately. This was before resnet. Then resnet came out and it changed everything. Then NLPs, Then Visual Transformers. 3dimensional depth mapping, GANs and now LLMs. Its progressive and exponential. No one could predict how soon the next breakthrough would be but they fell like dominoes.

You don't need middle management if you have no low level employees. Self-service kiosks are already being used in a lot of countries to replace workers. 3D printing is replacing other areas. They already have cleaning robots. Robots are fixed cost assets. People's expertise are recurring cost assets. Its clear which is the better investment from a business perspective short-term.

Anyone that isn't really worried about these things is going to be blindsided because they fundamentally don't understand the nature of the problem. Imagine a Code-GPT comes out in a few months that reads a requirements specification written in regular language and outputs code you'd normally have spent months writing in a few seconds. No expertise needed. You won't know ahead of time. Someone does it, publishes it, your entire profession is mostly out of a job.

If multiple chains cost cents, how much chaining needs to happen for it to equal minimum wage, let alone a mid-level salary?

You are wrong about your statement that innovations that increase productivity don't lead to losing jobs. They do when those productivity gains exceeds demand. Demand is constrained by the population.

While I'm not too worried about losing my job since I tend to do high IQ design work, those low and mid-IQ jobs normally filled by average or above average intelligence people will be hit the hardest.

You should be afraid, simply because the rate of change exceeds our ability to react in any meaningful way. If there is a problem, we'll never be able to see it coming until it is too late.

If you've done any significant study on socialism, you'd know both market and non-market socialism suffer from the economic calculation problem. Its not solved, people have been working on it for over a hundred years. Shortages cause failures which then cause death on a large scale. Universal Income is equivalent to non-market socialism where resources are simply moved around internally. There is no actual price discovery, prices deviate so much from the rational cost to produce those items that you run into characteristic issues of this problem.

Economic value by itself offers little. It can be solely concentrated in one person, or diffused throughout an entire country. One has benefit the other doesn't, but in terms of economic value they are the same. Its a made up number that doesn't measure what it claims to.

Re:Yann LeCun and Andrew Ng: Why the 6-Month AI Pause Is a B... by misssocrates on Friday April 07, 2023 @03:50PM (#35486200)
What do you make of Eliezer Yudkowsky's argument, who doesn't fit into any of those buckets?