News for hackers. Stuff that matters.
Re:Yann LeCun: AI one-percenters seizing power forever is re... by YetAnotherNick on Thursday November 02, 2023 @04:59AM (#38110713)
Global coordination using coercion has worked for nukes. It's very hard but not impossible to ban NVidia or any competitor and create spy network in all large companies and if any engineer is found to create AI, mark them as terrorist and give them POW treatment. And monitor chip fab like nuclear enrichment facility and launch war with country found to create chip fab, which I belive is hard to do it in complete secrecy.

I believe if top 5 nation agrees for this, it could be acheived. Even with US and China enforcing this, it could likely be acheived.

Re:Yann LeCun: AI one-percenters seizing power forever is re... by jeffparsons on Thursday November 02, 2023 @05:04AM (#38110757)
Sure, I think that kind of "coordination" is a little more credible than what I thought Eliezer was proposing. Maybe I just didn't read carefully enough.

One big difference here, however, is that the barrier to entry is lower. You can start doing meaningful AI R&D on existing hardware with _one_ clever person. The same was never true for nuclear weapons, so the pool of even potential players was pretty shallow for a long time, and therefore easier to control.

Re:Yann LeCun: AI one-percenters seizing power forever is re... by csomar on Thursday November 02, 2023 @05:37AM (#38111038)
I think in a few years you'll only be able to run signed software. And maybe any code you write will be communicate to some government entity somewhere to check for terrorism-impact? Well, the future is going to be very fun.
Re:Yann LeCun: AI one-percenters seizing power forever is re... by ta1243 on Thursday November 02, 2023 @11:22AM (#38114790)
> I think in a few years you'll only be able to run signed software

Frank Martucci will sort you out with an illegal debugger. Sure he'll go to jail for it when he's caught, but plenty of people risk that now for less.

Re:Yann LeCun: AI one-percenters seizing power forever is re... by johnthewise on Thursday November 02, 2023 @05:34AM (#38111008)
yeah, he proposed bombing rogue data centers by enforcing countries to be a viable option. he proposes this so we have a chance of solving alignment first, if that's even possible, not eliminating this risk once and for all. In the limit, if alignment is not solved, we are probably doomed.
Re:Yann LeCun: AI one-percenters seizing power forever is re... by YetAnotherNick on Thursday November 02, 2023 @05:23AM (#38110914)
> You can start doing meaningful AI R&D on existing hardware with _one_ clever person.

With the current hardware, yes. But then again countries could highly restrict all decently powerful hardware and backdoor them, and you need permission from government to run matrix multiplication above few teraflops. Trying to mess with backdoor is a war crime.

A weak form of hardware restriction even happens now that Nvidia couldn't export to many countries.

Re:Yann LeCun: AI one-percenters seizing power forever is re... by upupupandaway on Thursday November 02, 2023 @07:49AM (#38112142)
Re:Yann LeCun: AI one-percenters seizing power forever is re... by TeMPOraL on Thursday November 02, 2023 @06:17AM (#38111346)
> Maybe I just didn't read carefully enough.

It's this. This kind of coordination is exactly what he's been proposing ever since the current AI safety discussion started last year. However, he isn't high-profile enough to be reported on frequently, so people only remember and quote the "bomb data centres" example he used to highlight what that kind of coordination means in real terms.

Re:Yann LeCun: AI one-percenters seizing power forever is re... by jeffparsons on Thursday November 02, 2023 @07:08AM (#38111743)
Ah, okay. Thanks. The world makes a little more sense again!