News for hackers. Stuff that matters.
Re:Yann LeCun: AI one-percenters seizing power forever is re... by dragonwriter on Thursday November 02, 2023 @11:47AM (#38115190)
Yudkowsky’s call for declaring a global AI halt and engaging in unlimited warfare with anyone who defies it poses a greater and more immediate existential risk to humanity than AI ever could; it is largely mitigated (though still a bigger X-Risk than AI) because no one with the capacity to implement it in any substantive way takes him seriously at the moment.

But the people selling AI X-Risk that anyone with any policy influence is listening to are AI sellers using it to push regulatory capture, so those are the people being talked about when people are discussing X-Riskers as a substantive force in policy discussions, not the Yudkowsky cult, which, to the extent it is relevant, mostly provides some background fear noise which the regulatory capture crew leverages.

Re:Yann LeCun: AI one-percenters seizing power forever is re... by 3rd3 on Thursday November 02, 2023 @02:49PM (#38118230)
> Yudkowsky’s call for declaring a global AI halt and engaging in unlimited warfare with anyone who defies it

Could you provide a link to where he said this?

Re:Yann LeCun: AI one-percenters seizing power forever is re... by dragonwriter on Thursday November 02, 2023 @06:07PM (#38120953)
I think he's said it many times in slightly different ways, but one notable one:

https://time.com/6266923/ai-eliezer-yudkowsky-open-letter-no...

The moratorium on new large training runs needs to be indefinite and worldwide. There can be no exceptions, including for governments or militaries. If the policy starts with the U.S., then China needs to see that the U.S. is not seeking an advantage but rather trying to prevent a horrifically dangerous technology which can have no true owner and which will kill everyone in the U.S. and in China and on Earth.

.

.

.

Shut down all the large GPU clusters (the large computer farms where the most powerful AIs are refined). Shut down all the large training runs. Put a ceiling on how much computing power anyone is allowed to use in training an AI system, and move it downward over the coming years to compensate for more efficient training algorithms. No exceptions for governments and militaries. Make immediate multinational agreements to prevent the prohibited activities from moving elsewhere. Track all GPUs sold. If intelligence says that a country outside the agreement is building a GPU cluster, be less scared of a shooting conflict between nations than of the moratorium being violated; be willing to destroy a rogue datacenter by airstrike.