News for hackers. Stuff that matters.
Re:AI Nationalism by garmaine on Thursday June 14, 2018 @01:01PM (#17313155)
Devil’s advocate: success is a step function. AI isn’t going to take over the world until it is able to, and then it very rapidly does.
Re:AI Nationalism by YeGoblynQueenne on Thursday June 14, 2018 @03:38PM (#17314687)
>> AI isn’t going to take over the world until it is able to, and then it very rapidly does.

The question is, of course- how? How will AI become able to take over the world?

This is an important question to ask because predictions of AI rapidly becoming capable of taking over the world tend to flare up in times of progress in AI performance. For example, the above article is basically based on the preimse that the latest developments, i.e. deep learning, are sufficient to give some nation-state technological supremacy by leading directly to AGI.

However, there is no clear path from deep learning, however powerful it may be as a set of techniques to train classifiers, to AGI, which (well, probably) entails much more than powerful classification. For instance, deep learning can't really do inference. It seems reasonable to assume that AGI will need the ability to reason about the objects it can recognise and the relations between them. Deep learning can't do causal analysis- like Judea Pearl has been screaming from the rooftops lately. It seems reasonable again to assume that AGI will need to model causal relations. Deep learning can't do semantics. AGI will need to have some handle on semantics. And so on and so forth.

In general, anyone that claims that X current development in AI risks inadvertently producing AGI, must explain how this is supposed to happen- not just wave their hands about and claim that, if you throw enough compute and enough data at the problem, magic will happen and AGI will turn us all into paperclips.

Re:AI Nationalism by laichzeit0 on Thursday June 14, 2018 @02:06PM (#17313851)
What seems more likely at this point is that: machine translation will get so good that it will be better at translating between languages than any human can; image classifiers will become so good that they will be better at classifying images than any human can; self-driving cars will become so good that they will be better at driving than any human can; etc. etc.

I think the mismatch comes when people looking from the outside who have no real understanding of how the internals work see this progress in a very narrow domain and extrapolate that idea into thinking that something more general is happening.

When you understand the trick, it stops being magic.

Re:AI Nationalism by EliasY on Thursday June 14, 2018 @02:59PM (#17314381)
Adding to the fact that thousands of tricks are involved in the resourcefulness of the human brain and that each trick has multiple ways to interact with other tricks or modify itself . Duplicating this feat into machines isn't a simple matter. AGI isn't going to be some miracle of ML or any one technique. It requires simulating several different self selective learning models and their managers including a way to learn and debug better ways of learning, combining at least 10 different realms of knowledge and process representation including language abstractions, several tools for selecting which method for learning/remembering/acting is appropriate, several strategies for goal creation, selection, planning, execution and evaluation, a robust and scalable memory architecture, a dependable way to interact with the environment, programs for self evaluation and debugging.... the list goes on..... Bottom line is that nobody can get all this functionality from a few optimization algorithms...
Re:AI Nationalism by citrablue on Thursday June 14, 2018 @06:03PM (#17315837)
Didn't we already get all this functionality from one optimization algorithm, namely, biological evolution?
Re:AI Nationalism by EliasY on Thursday June 14, 2018 @11:36PM (#17317364)
Yes. But I don't think we've millions of years to make that happen nor do we have the capabilities or the knowledge to create the environmental situations that could potentially reinforce these mutations.
Re:AI Nationalism by citrablue on Friday June 15, 2018 @12:06AM (#17317484)
The timeline only matters if the generational period is the same. For the rest, I agree that we don't currently. But things change.
Re:AI Nationalism by garmaine on Thursday June 14, 2018 @05:50PM (#17315730)
So we're in agreement, right?

> When you understand the trick, it stops being magic.

The only argument I've seen about the difficulty of general AI is that we don't presently know how to do it. But it only seems difficult (like magic) because of our lack of comprehension. Maybe it actually is, but the good odds are that like everything else it's just one or a couple of tricks, and once we put the pieces together we'll be moving just as fast.

Re:AI Nationalism by klipt on Thursday June 14, 2018 @02:26PM (#17314083)
If a machine can drive a car, how much harder is it to drive a tank?

If a machine can generate strategies to win simulated wars, how much harder is it to generate strategies to win real wars?

If machines can out compete people on 50% of jobs, how much harder is it to out compete people on 100% of jobs?

Re:AI Nationalism by YeGoblynQueenne on Thursday June 14, 2018 @03:43PM (#17314736)
Well, even for humans driving a car doesn't mean you can drive a tank; being good at Rome: Total War or Starcraft doesn't mean you can win a real war; and we're a long way away from "machines" being able to outcompete 50% of humans at their jobs.
Re:AI Nationalism by red75prime on Thursday June 14, 2018 @02:46PM (#17314268)
Some day we will understand how we do our tricks though.
Re:AI Nationalism by garmaine on Thursday June 14, 2018 @05:48PM (#17315707)
Or alternatively, how to accomplish the same thing in an easier way -- we don't fly in commercial aircraft by flapping feathered wings, after all. And then magic will be dissolved and we might find that general AI isn't really all that much harder than narrow AI.
Re:AI Nationalism by goatlover on Thursday June 14, 2018 @01:29PM (#17313451)
Devil's devil's advocate. The world is too complicated to be reduced to a function. AI isn't going to take over the world anymore than anyone else has (governments and organizations included).
Re:AI Nationalism by fossuser on Thursday June 14, 2018 @02:34PM (#17314147)
Take the human general intelligence learning architecture and scale it up to a billion operations a second.

The trick with AGI is that it can learn faster, and humans (even with our limitations) did take over the world.

Re:AI Nationalism by goatlover on Thursday June 14, 2018 @04:49PM (#17315253)
So one AGI is like a billion human beings, so a little bit less than China or India. And like countries, there will be other AGIs. An AGI isn't born in a vacuum, it comes into existence in a world advanced enough for such a tech to be developed. As such, it's reasonable to suppose there will limitations for AGIs when it decides that world conquest is a worthy goal.
Re:AI Nationalism by fossuser on Thursday June 14, 2018 @05:46PM (#17315687)
It's not like one billion human beings.

Humans are limited by a lot of things like motivation and communication which is likely distinct from the general problem solving architecture itself. Humans also have goals and an evolved morality that guides their thinking. Humans share a similar type of intelligence and understanding of goals, culture, right and wrong. You don't get this for free with AGI.

The point of the human example is that there already exists a general problem solving architecture you can scale up (it's not impossible and there are brains everywhere in nature).

If you increase operations per second many magnitudes you can have all human learning over thousands of years compressed into a couple of hours. You see this loosely in narrow spaces now with things like Alpha Go Zero.

There may not be other AGIs if there's an intelligence explosion and the first one improves itself very quickly. If its utility function is not aligned with human goals then it could end up turning all matter into paperclips - not because it's evil, but because it's hard to set goals tied to human morality (when humans don't even agree in every case) and it happens to be configured such that making paperclips maxes out its reward function by accident.

It may be possible to make the unsafe version before making the safe one, since it seems harder to make an AGI that's aligned with human goals than just an AGI in general.

Re:AI Nationalism by canjobear on Thursday June 14, 2018 @02:10PM (#17313907)
> The world is too complicated to be reduced to a function.

I can only interpret this as a mystical claim...

Re:AI Nationalism by cornholio on Thursday June 14, 2018 @02:24PM (#17314068)
The world is too complicated to be reduced to a function that does not exhibit general intelligence. At minimum, able to formulate rational strategies in arbitrary games against other rational adversaries.
Re:AI Nationalism by goatlover on Thursday June 14, 2018 @04:47PM (#17315237)
The mystical claim is that the world is like a board game where we can extrapolate from the success of AlphaGo/Zero to AGI taking over the world.

That's just pure speculation because nobody has a clue what such an intelligence would look like. I can imagine using the mind infinity stone to take over the world, but that doesn't make it realistic.

Re:AI Nationalism by red75prime on Friday June 15, 2018 @02:39AM (#17317907)
We have a working model of general intelligence. It runs on 20 watts, takes 20 years to became somewhat usable, and is known to cause local disasters.
Re:AI Nationalism by gowld on Thursday June 14, 2018 @01:46PM (#17313638)
"the world" is vague. Governments certainly have taken over various worlds.
Re:AI Nationalism by garmaine on Thursday June 14, 2018 @05:46PM (#17315691)
Organizations of humans (governments) seem to have conquered the world pretty well, outside of a scant few lawless areas. Even then there's usually some local warlord maintaining order, just not a nation state. I'm not sure what you're trying to say?