News for hackers. Stuff that matters.

A comment on The Darwinian argument for worrying about AI. Parent comment

Re:The Darwinian argument for worrying about AI by avgcorrection on Friday June 30, 2023 @01:51PM (#36539270)
> The near term risk isn't super intelligence, it's the paper-clip optimizer pushing the wrong button.

This has already happened. The paper clip optimizer was capitalism.

Just listen to some heatwave weather forecasts once in a while (as an example).

[ Parent | on HN ]
Re:The Darwinian argument for worrying about AI by staunton on Friday June 30, 2023 @08:35PM (#36544755)
There may be more than one thing. Capitalism as an information processing system is quite slow. Computers can be faster.
[ Parent | on HN ]
Re:The Darwinian argument for worrying about AI by avgcorrection on Saturday July 01, 2023 @09:30AM (#36549903)
“Already happened” merely means that it is not a hypothetical scenario any more.
[ Parent | on HN ]
Re:The Darwinian argument for worrying about AI by lukifer on Saturday July 01, 2023 @11:57AM (#36551465)
To anyone who says we can just flip the off switch on AIs who go rogue: where exactly is the off switch to capitalism, or corporations, or global supply chains, or industrialized agriculture, or social media, or the State?

AIs aren't a new phenomenon: we've been co-evolving with them for millennia, for both good and ill. The new more powerful iterations ("vast arrays of inscrutable floating-point matrices") are nested in those previous memetic life forms (corporations in particular [0]); and once something becomes infrastructure (and/or an income stream to some subset of humanity), it becomes non-trivial, if not impossible, to turn off.

[0] https://omniorthogonal.blogspot.com/2013/02/hostile-ai-youre...

[ Parent | on HN ]