Re:FTC investigating ChatGPT over potential consumer harm
by godelski on Friday July 14, 2023 @02:43PM
(#36728166)
> I remain puzzled as to why any CEO would stir up the government like this.
I have a belief, as a ML researcher, that there are two types of x-risk AI/ML researchers. True believers and hype-men. People do hype the x-risk because it is catchy and gets more people talking. The whole "no news is bad news" strategy, which even worked in recent elections. I think there's two dangers to these people: 1) they eventually turn into true believers (you say something enough, you start to believe it), and 2) it distracts from the risks of the current dangers. For Sam, I think he is a true believer and I'd expect this out of any CEO who spends significant amounts of time hyping people up to gather capital by promising a future AGI.
As for myself, I'm not buying the x-risk arguments. There's a lot I have to say and a lot of nuance, but to put it briefly I'll reference something Mitchel said. She noted how it seems rather unlikely that a super-intelligence, who outperforms us in every single way is also unable to understand intention behind instructions (meaning it doesn't understand us, so a contradiction in super-intelligence). The danger is handing things over to a model without human supervision and letting it hallucinate. So the danger is thinking it is smarter than it actually is, and then trusting it. Concentrating on ineffable abilities of super-intelligences distracts us from this danger, which already exists.
I have a belief, as a ML researcher, that there are two types of x-risk AI/ML researchers. True believers and hype-men. People do hype the x-risk because it is catchy and gets more people talking. The whole "no news is bad news" strategy, which even worked in recent elections. I think there's two dangers to these people: 1) they eventually turn into true believers (you say something enough, you start to believe it), and 2) it distracts from the risks of the current dangers. For Sam, I think he is a true believer and I'd expect this out of any CEO who spends significant amounts of time hyping people up to gather capital by promising a future AGI.
As for myself, I'm not buying the x-risk arguments. There's a lot I have to say and a lot of nuance, but to put it briefly I'll reference something Mitchel said. She noted how it seems rather unlikely that a super-intelligence, who outperforms us in every single way is also unable to understand intention behind instructions (meaning it doesn't understand us, so a contradiction in super-intelligence). The danger is handing things over to a model without human supervision and letting it hallucinate. So the danger is thinking it is smarter than it actually is, and then trusting it. Concentrating on ineffable abilities of super-intelligences distracts us from this danger, which already exists.