News for hackers. Stuff that matters.
Re:Artificial intelligence: machine v man by Animats on Sunday November 02, 2014 @02:13AM (#8545929)
Strictly speaking, according to Bostrom, the kind of machine-based intelligence that is heading humanity’s way wouldn’t wish its makers harm. But it would be so intent on its own goals that it could end up crushing mankind without a thought, like a human stepping carelessly on an ant.

Like corporations.

What happens when computers get good at management? A network of computers may be able to outperform human managers. Even if they're not quite as smart as the smarter humans, a network of computers can coordinate better than a meeting of people. Once computer-run companies start producing better returns than human-run ones, the computer-run ones will dominate. That's basic capitalism.

This doesn't imply that the organization is entirely automated. It just means humans aren't at the top. If it produces more profits, companies will be forced by investors to take that route.

Re:Artificial intelligence: machine v man by robotkilla on Sunday November 02, 2014 @04:03AM (#8546131)
I suspect at some point in time, (left without regulation) computers and machines will even replace programmers, which is pretty much what the article is saying, that would be one of the low level steps.

It seems that people think either a utopia ensues or that's our extinction event – I don't understand why we think everything will spiral out of our control though. We still have the power – we don't have to turn it over to the robots now or ever.

Re:Artificial intelligence: machine v man by hedges on Sunday November 02, 2014 @08:29AM (#8546535)
>We still have the power – we don't have to turn it over to the robots now or ever.

In theory, but can we control ourselves? There are a lot of financial incentives in developing better machines and algorithms. We couldn't stop nuclear weapons or global warming, and AI is a lot more attractive and powerful than either of those to business and governments. Not to mention that nuclear weapons and global warming are harmful in a very easily understood way, whereas AI might be harmful in very strange ways. It's like a pack of wolves left alone with a poisonous steak. It's a delicious steak and the poison is somewhat beyond their understanding; some wolves even think there's no poison at all. Isolating the poison from the steak is as difficult for the wolves as making safe AI is for us.

You can imagine how incredibly valuable an AI capable of doing a programmer's work would be. It's a technology far off, but not implausible.

But as soon as we reach that point, it seems unlikely that things won't spiral out of control. Imagine a thousand highly intelligent programmers who are capable of research, think fluently in statistics, and cooperate perfectly. Additionally, these programmers can examine and modify how their own brains work, and boost their performance, remove their errors. With the press of a button, they can also create more copies of themselves.

Everything might spiral out of control.

How do you make sure things don't spiral out of control?

Re:Artificial intelligence: machine v man by robotkilla on Sunday November 02, 2014 @09:55AM (#8546701)
International laws and regulations as well as doomsday scenario planning that is surely already underway by the US government.

I would argue that we actually have stopped nuclear weapons thus far (not the proliferation, but the usage), as well as mass global terrorism, mass extinction from disease, the list goes on.

I agree that AI is a threat – I'm legitimately worried that the AI capable of doing a programmer's work isn't all that far off. I see things like Mozilla's Webmaker popping up and its obvious that the process will become more streamlined and automated as time goes on. I also don't think that all sense and reason goes out the window - we will come up with a way to solve it like we solve everything else – boring laws.

We should be more worried about the human beings that will no doubt use the new wave of machines for their own ill will. I'm sure what the NSA has right now will be laughable compared to what it will have in 10 years.

Re:Artificial intelligence: machine v man by irickt on Sunday November 02, 2014 @10:29AM (#8546815)
Here's the fallacy with these scenarios: It's not AI vs humans with sharpened sticks. It's not-quite-yet autonomous AI vs humans using the same technology the would-be AI is using. In this scenario I give humans the edge.
Re:Artificial intelligence: machine v man by tomrod on Sunday November 02, 2014 @08:43AM (#8546559)
Does the computer owner/shareholders maintain the residual rents? If so, I think you may be spot on.