It is also an extremely good advertisment. Getting in front of the global press and telling them how dangerous the technology you can use right now, on their web site is, is absolutely awesome marketing.
Edit: Upon further thought, I suppose that’s the appeal of the nuclear analogy? “Nuclear power is to nuclear weapons as ‘aligned’ super intelligent AI is to malevolent superintelligent AI?
Having the debate is advertisment enough. "Maybe this could kill us all, maybe not? Try it out at openai.com and see for yourself." Seems like a very good promotion.
And his stance obviously isn't that AI is so dangerous that his company should be shut down.
I’m not sure their success shows that the strategy of warning of existential risk is working. Arguably, the success could be entirely due to word-of-mouth marketing from people posting their ChatGPT sessions and media talking about GPT’s capabilities with little skepticism. But it’s certainly not hurting it significantly, and on balance it probably is helping.
Achieving GPT-4 deserves a lot of credit. It’s true, it was built on stolen books, ideas, renegading on the non-profit and using the technology brought by xooglers, but it hardly matters. It’s a clear success and achieved vision of an AI.
So it is certainly worth listening to the predictions and ideas that are coming from the same team.
His being untrustworthy isn't why I think he's wrong, although I think he's being intentionally wrong in order to achieve sketchy goals.
> So it is certainly worth listening to the predictions and ideas that are coming from the same team.
It's worth listening to them. I don't think it's reasonable to accept what they're saying at face value, though.
Is that likely to happen here, when the moat is so much wider? As long as training a model takes exaflop (zettaflop?)-level computing resources, the moat is very real.
It's absolutely this.
He's selling us the threat of extinction while actively working to undermine the very idea of industry itself.
I'll take a page out of his book and turn my garage into a meth lab, then offer to protect the neighbors from the danger it poses by selling only the purest of meth to their kids so they don't try to buy it from some shady guy who'll lace it with fentanyl.
The only thing that makes sense to me is that he's trying to distract the world from actual risks of LLMs by getting everyone worked up about imaginary risks of LLMs.
But I need to admit my bias. I considered Sam Altman to be sketchy and untrustworthy from before OpenAI existed, so I'm going to be very skeptical of anything he has to say and his motives for saying it.