News for hackers. Stuff that matters.
Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by JohnFen on Wednesday June 07, 2023 @01:29PM (#36230083)
I wish I understood what Sam Altman is trying to accomplish here. Regardless of your opinion of LLMs and their potential impact, he seems to be talking weird nonsense.

The only thing that makes sense to me is that he's trying to distract the world from actual risks of LLMs by getting everyone worked up about imaginary risks of LLMs.

But I need to admit my bias. I considered Sam Altman to be sketchy and untrustworthy from before OpenAI existed, so I'm going to be very skeptical of anything he has to say and his motives for saying it.

Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by constantcrying on Wednesday June 07, 2023 @01:33PM (#36230171)
Regulation hugely benefits established companies. Startups would have to deal with hugely complex legal problems just to exist, while the cost for compliance is insignificant to larger companies.

It is also an extremely good advertisment. Getting in front of the global press and telling them how dangerous the technology you can use right now, on their web site is, is absolutely awesome marketing.

Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by actuallyalys on Wednesday June 07, 2023 @02:03PM (#36230748)
I’m curious how many people he’s actually convincing. It seems like trying to argue that people should buy your product and also that that same product category could have existential risks would raise doubts. Perhaps the “AI is dangerous but not yet” line will work though.

Edit: Upon further thought, I suppose that’s the appeal of the nuclear analogy? “Nuclear power is to nuclear weapons as ‘aligned’ super intelligent AI is to malevolent superintelligent AI?

Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by constantcrying on Wednesday June 07, 2023 @02:11PM (#36230881)
Given the enormous success of his company in acquiring users, I think he has done quite well.

Having the debate is advertisment enough. "Maybe this could kill us all, maybe not? Try it out at openai.com and see for yourself." Seems like a very good promotion.

And his stance obviously isn't that AI is so dangerous that his company should be shut down.

Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by actuallyalys on Wednesday June 07, 2023 @02:35PM (#36231345)
Agreed in the debate being an advertisement in itself.

I’m not sure their success shows that the strategy of warning of existential risk is working. Arguably, the success could be entirely due to word-of-mouth marketing from people posting their ChatGPT sessions and media talking about GPT’s capabilities with little skepticism. But it’s certainly not hurting it significantly, and on balance it probably is helping.

Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by simfree on Wednesday June 07, 2023 @01:33PM (#36230151)
Creating a moat slowing or preventing other entrants through arbitrary regulation seems to be the goal, free and open source models would be at a huge disadvantage under the new models being pitched today.
Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by startupsfail on Wednesday June 07, 2023 @01:33PM (#36230168)
He is certainly sketchy, mendacious and untrustworthy. It doesn’t mean that he is necessarily wrong.

Achieving GPT-4 deserves a lot of credit. It’s true, it was built on stolen books, ideas, renegading on the non-profit and using the technology brought by xooglers, but it hardly matters. It’s a clear success and achieved vision of an AI.

So it is certainly worth listening to the predictions and ideas that are coming from the same team.

Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by JohnFen on Wednesday June 07, 2023 @02:02PM (#36230733)
> He is certainly sketchy, mendacious and untrustworthy. It doesn’t mean that he is necessarily wrong.

His being untrustworthy isn't why I think he's wrong, although I think he's being intentionally wrong in order to achieve sketchy goals.

> So it is certainly worth listening to the predictions and ideas that are coming from the same team.

It's worth listening to them. I don't think it's reasonable to accept what they're saying at face value, though.

Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by theGnuMe on Wednesday June 07, 2023 @01:59PM (#36230672)
It'll be about as effective as taxi medallions imho.
Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by CamperBob2 on Wednesday June 07, 2023 @02:48PM (#36231569)
Those were basically 100% effective. It literally took a popular revolt to break the taxi cartel's stranglehold. The majority of customers decided they would rather participate in an illegal business model -- one that involved getting into strangers' cars, no less -- than put up with taxis any longer.

Is that likely to happen here, when the moat is so much wider? As long as training a model takes exaflop (zettaflop?)-level computing resources, the moat is very real.

Re:OpenAI CEO suggests agency like UN’s nuclear watchdog cou... by jstarfish on Wednesday June 07, 2023 @03:15PM (#36231999)
> The only thing that makes sense to me is that he's trying to distract the world from actual risks of LLMs by getting everyone worked up about imaginary risks of LLMs.

It's absolutely this.

He's selling us the threat of extinction while actively working to undermine the very idea of industry itself.

I'll take a page out of his book and turn my garage into a meth lab, then offer to protect the neighbors from the danger it poses by selling only the purest of meth to their kids so they don't try to buy it from some shady guy who'll lace it with fentanyl.