How convolutional neural networks see the world

Re:How convolutional neural networks see the world by fennecfoxen on Sunday January 31, 2016 @10:43PM (#11009599)

An AI doesn't have to understand the world in order to destroy it. It needs to be hooked up to the one technology which could credibly destroy the world: a nuclear weapons system. A very poorly designed nuclear weapons system that doesn't have any meaningful interlocks.

Myself, I'm going to remain much more worried about the natural intelligences which have been hooked up to nuclear weapons systems.

[ Parent | on HN ]

Re:How convolutional neural networks see the world by crucialfelix on Monday February 01, 2016 @06:20AM (#11011102)

It doesn't need to be something big and scary like a nuclear weapons system.

It could be hooked up to the stock market, and it could make entirely rational decisions based on its objective (profitable trades) and these actions can result in imbalances leading to famine in certain regions, increased pollution, unsustainable depletion of natural resources etc.

We are already hooked up. The AIs are just amplifications of our own narrowly focused objectives.

[ Parent | on HN ]

Re:How convolutional neural networks see the world by CuriouslyC on Monday February 01, 2016 @10:35AM (#11012292)

Algorithmic trading systems have already gone haywire, repeatedly in fact. All major stock markets "circuit breaker" systems in place to halt trading in the event of extreme volatility for specifically this reason.

The sort of long range damaging activities you mention are unlikely though, as algorithmic trading systems in general take their long term cues from humans.

[ Parent | on HN ]

Re:How convolutional neural networks see the world by dr_zoidberg on Monday February 01, 2016 @11:55AM (#11012968)

Then it has already happened[0], but few seem to recognize it.

[0] https://en.wikipedia.org/wiki/2010_Flash_Crash

[ Parent | on HN ]