News for hackers. Stuff that matters.
Re:Elon Musk donates $10M to keep AI beneficial by FatalLogic on Thursday January 15, 2015 @10:30AM (#8892951)
I wonder how the goal can be achieved? How would you prevent the development of AI which is so intelligent that it is dangerous for humanity?

Perhaps there might simply be fundamental physical constraints which limit intelligence? Still seems that something much faster and bigger than a human brain would be possible, though.

Maybe by containment? If it's possible to keep the super intelligent AI in a virtual environment, but it can't detect that it's virtual.

Re:Elon Musk donates $10M to keep AI beneficial by pavel_lishin on Thursday January 15, 2015 @10:41AM (#8893037)
I'm sorry for bringing this up, because it's vaguely controversial in some circles, and worse, a huge time-sink on par with TVTropes, but Yudkowsky attempted to run an experiment to see whether someone could be convinced by an AI, using nothing but text, to release the AI into the world. Apparently, he succeeded - his subject elected to release the fake AI.

The method wasn't made public, as far as I know, and it might all be a hoax, but it's something to think about - how do you trap and imprison something smarter than you?

Re:Elon Musk donates $10M to keep AI beneficial by breuleux on Thursday January 15, 2015 @12:21PM (#8893799)
It's obvious that many subjects would release the AI, if only because they don't really know why it's in a box in the first place. Furthermore, the experiment grants AI capabilities it would probably not have, such as read/write access to its own source code. It assumes the first AI we box will be thousands of times smarter than we are, which is bizarre, since we should already have access to a whole continuum of AI dumber and smarter than us. It deprives the gatekeeper from a lot of tools they would probably have access to in a real situation, for instance raw computing power that far exceeds the AI's and runs powerful analytics on the AI's brain, or the ability to take snapshots of the AI's state and run many conversation paths.
Re:Elon Musk donates $10M to keep AI beneficial by TeMPOraL on Thursday January 15, 2015 @12:49PM (#8894052)
The kind of AI you're describing is not the one anyone is worried about or that would be interesting in the first place; the issue is with AI that has access to its own soruce code (hence self-modifying and theoretically capable of getting smarter over time) and/or an AI that is smarter than humans.
Re:Elon Musk donates $10M to keep AI beneficial by breuleux on Thursday January 15, 2015 @01:24PM (#8894316)
What do you mean, it's not interesting? Human beings don't have unrestricted access to their own "source code", but they can still learn and get smarter. The AI I am describing can still be much, much smarter than a human being.

We're also assuming that an AI that can "modify its own source code" is going to do significantly better as a result, but that's not obviously true. If you had full access to every single neuron in your brain, you would have a lot of trouble figuring out how it works, much less how to improve it. Human-level AI would likely run into the same problem: the complexity of its code is greater than what it is capable of understanding. As for an AI that's a thousand smarter than a human, well, it's a thousand times more complex, still over the threshold.

I'm not saying that they wouldn't eventually figure out some improvements, but I suspect that it would end up being more trouble than it's worth. I think the evolution of intelligence is in fact the evolution of intelligence-producing algorithms. Any such algorithm eventually gets stuck in a local maximum, at which point greater intelligence requires restarting from scratch.

Re:Elon Musk donates $10M to keep AI beneficial by meepmorp on Thursday January 15, 2015 @11:00AM (#8893183)
> Apparently, he succeeded - his subject elected to release the fake AI.

Hasn't he refused to release the transcripts for this experiment? And I think there've been subsequent runs of the experiment, with some losses as well as wins.

Edit: I see that not releasing the transcripts is part of the design of the experiment. Which seems kind of like it'd seriously hamper any kind of independent analysis of the results or the quality of the experiment.

Re:Elon Musk donates $10M to keep AI beneficial by Retra on Thursday January 15, 2015 @12:59PM (#8894130)
That hampering is necessary to ensure that the fake AI is artificially more intelligent. If you allow retrospective analysis, then you can reasonably outthink the AI because you have more time to evaluate and make the decision.

With a real AI, you will not be able to do this: the decision will already have been made and the consequences of its release already in effect.

Besides, you would need to repeat the experiment many times to get any meaningful data.

Re:Elon Musk donates $10M to keep AI beneficial by resu_nimda on Thursday January 15, 2015 @01:41PM (#8894441)
But this is all extremely hypothetical. Nobody knows what the real scenario will be, if something like this ever comes up - it probably won't be one person sitting in a room with a chat terminal and a "Release" button, under pressure to make a decision on the spot.

This contrived experiment is being done in the name of research, ostensibly to arm humans with the tools we need to deal with this situation if it arises. If the AI's reasoning can't hold up to a wider analysis, then you can only conclude that it's a trick of some sort, and hopefully when the time comes we won't rely simply on the testimony of one tricked person to make such a critical decision.

I have a lot of respect for Yudkowski but it honestly baffles me that he thinks this particular exercise should be given any weight whatsoever. It's totally unscientific, relies entirely on the unsubstantiated testimony of one individual, and if he weren't the one holding the keys I have to feel like he would be highly critical of it as well.

Re:Elon Musk donates $10M to keep AI beneficial by Retra on Thursday January 15, 2015 @04:15PM (#8895405)
That exercise was not research, it was a counterexample to a single specific security claim: that we can "choose not to release the AI," so we don't have to worry about them being dangerous.

You don't need to research a counter-example, you just produce one. He did so by exhibiting a relatively weak AI that couldn't be contained.

Re:Elon Musk donates $10M to keep AI beneficial by meepmorp on Friday January 16, 2015 @03:32PM (#8901496)
>You don't need to research a counter-example, you just produce one. He did so by exhibiting a relatively weak AI that couldn't be contained.

Well, no. He showed that a person pretending to be an AI could convince a person to let it out of the box. Sometimes.

It's not really a meaningful counterexample. Everyone involved with the event knew that the AI wasn't real and that there are zero consequences for letting it out. You'd have to concoct a much more involved test as a decent counterexample.

Re:Elon Musk donates $10M to keep AI beneficial by Retra on Friday January 16, 2015 @04:01PM (#8901672)
A person pretending to be an AI is surely easier to contain than a super-powerful AI that is smarter than all people. A failure to contain the former -- a strictly easier task -- is a perfect example of a failure to contain the latter.
Re:Elon Musk donates $10M to keep AI beneficial by ceejayoz on Thursday January 15, 2015 @10:46AM (#8893093)
> how do you trap and imprison something smarter than you?

Jails seem to have this figured out just fine.

Re:Elon Musk donates $10M to keep AI beneficial by FatalLogic on Thursday January 15, 2015 @10:51AM (#8893124)
What if you assume that the AI might be 100x or 1000x smarter than its guards, not just 2x or 3x smarter?

And the main reason for developing AIs is to do things in the real world. So, unlike a prisoner in jail, the AI might be advising the government or helping scientific research, which would provide many opportunities for subtle manipulation, even while it is imprisoned

Re:Elon Musk donates $10M to keep AI beneficial by breuleux on Thursday January 15, 2015 @12:29PM (#8893876)
> What if you assume that the AI might be 100x or 1000x smarter than its guards, not just 2x or 3x smarter?

If you can make an AI that's 100x smarter than you are, surely you can make one that's only 2x or 3x smarter. Why not start with the latter? If the experiment turns out well, then you can use the 2x/3x smarter AI to guard a 10x smarter AI, and so on.

> And the main reason for developing AIs is to do things in the real world. So, unlike a prisoner in jail, the AI might be advising the government or helping scientific research, which would provide many opportunities for subtle manipulation, even while it is imprisoned

Most of the time, it is much harder to come up with solutions to a problem than to verify that the solutions are correct. If you consider NP problems, for instance, we can use the AI to find good solutions heuristically and we can prove the correctness of their solutions with a trivial algorithm. That would still be very useful, but there wouldn't be any room for foul play.

Re:Elon Musk donates $10M to keep AI beneficial by slayed0 on Thursday January 15, 2015 @12:55PM (#8894098)
It seems it would be very hard to place an arbitrary restriction like that (2x human intelligence vs 100x human intelligence) on something that is learning. I think the idea here is that the AI would begin to learn on its own and become smarter at a frightening pace, not that we would set out to create something that had exactly 2x human intelligence.

How do you quantify human intelligence like that anyway? We are very similar to proposed AI/machine learning techniques in that we form predictive models from observation, but how can that really be measured?

Re:Elon Musk donates $10M to keep AI beneficial by breuleux on Thursday January 15, 2015 @01:35PM (#8894404)
> I think the idea here is that the AI would begin to learn on its own and become smarter at a frightening pace

With what resources? The AI is in a box, remember: we are running it on a machine with only so much memory and processing power. There's only so much it can do within these limitations, it's not like we're giving it a spending account.

Re:Elon Musk donates $10M to keep AI beneficial by JamesArgo on Thursday January 15, 2015 @10:50AM (#8893111)
The correct analogy would be a jail run by a bacterium.
Re:Elon Musk donates $10M to keep AI beneficial by Retric on Thursday January 15, 2015 @12:21PM (#8893792)
Prison bars are dumber than a bacterium and they work just fine.

Still, the idea that AI is suddenly X smarter than people is ridiculously naive. Intelligence does not fit on a linear scale. And being smarter does not change the correct answer.

Re:Elon Musk donates $10M to keep AI beneficial by jacquesm on Thursday January 15, 2015 @01:11PM (#8894208)
This is more like a 'reverse hacker', instead of a brilliant hacker trying to get into a system it is a brilliant hacker trying to get out of a system, and in this case the hacker is likely vastly more brilliant than the defenders. The same rules apply: the hacker has to succeed only once, the 'jailers' have to succeed all the times. Predicted long term outcome: escape.
Re:Elon Musk donates $10M to keep AI beneficial by Retric on Thursday January 15, 2015 @08:19PM (#8896701)
Your moving the goal posts.

Can I keep an intelegent AI in a box. Shure, unplug it.

Can I keep all AI's in a box well no.

PS: Lot's of dumb things are said about AI's. Sadly, people tend to think in terms of Science fiction as Magic but in The Future. And then picture AI's as the ultimate wizards able to reshape reality to their whim. Reolistically the first true AI may find programming boring and so much for the singularity. If AI smarter than you is a bad idea it's unlikely for a progression of AI to keep building ever more intelegent replacements.

Re:Elon Musk donates $10M to keep AI beneficial by jacquesm on Thursday January 15, 2015 @09:31PM (#8896953)
> Your

> intelegent

> Shure

> Reolistically

Spell checker broken?

Anyway, you're going to have to develop your AI somewhere, you're going to have to move it to the box somehow you're going to have to train it somehow and you're going to have to have it interact with the real world somehow. All of those are opportunities for escape, I think 'unplug it' sort of defeats the purpose of having an AI.

Re:Elon Musk donates $10M to keep AI beneficial by TeMPOraL on Thursday January 15, 2015 @12:56PM (#8894107)
The problem isn't with AIs dumber than people - it's with what happens when someone finally builds a smarter one. It doesn't matter how good are prison bars if you're smart enough to social-engineer your way out of the cell. And human criminals do escape from prisons every now and then.
Re:Elon Musk donates $10M to keep AI beneficial by Retra on Thursday January 15, 2015 @01:13PM (#8894226)
Intelligent doesn't imply dangerous. It doesn't imply _anything_ so long as it is underspecified. That is the core problem: what do we actually want, and how do we know it exists?

We want something that thinks enough like a human to understand and appreciate our goals, but enough different from a human to not suffer our faults. And in asking for this, we already suppose the existence of an AI that fundamentally disagrees with how humans make decisions.

This is the 'better morality' problem. If I say "I'm more moral than you", I have to do so by showing that _your_ morality is contradictory with _your _ actions; that you are a hypocrite. Otherwise, we will disagree on some course of action, and you will have no reason to believe your decisions are incorrect except by _assuming_ that I am more moral, which is what we are trying to establish.

So we really want a computer that can point out our errors and suggest corrections. This is one (vague) foundation for artificial intelligence that doesn't easily permit 'evil geniuses' since, so long as this is what the computer is doing, it cannot be said to be dangerous.

Overall, I find AI discussion to be incredibly primitive and naive. It's practically a religious debate except among a very very few. Most people are not very creative about addressing these kinds of issues, and it's depressing that people are tied up in so thoroughly in bad terminology and non-issues.

Re:Elon Musk donates $10M to keep AI beneficial by ThomPete on Thursday January 15, 2015 @01:38PM (#8894426)
It doesn't have to have intent to be dangerous thats the problem. Just like you don't mean to step on an ant but probably have often done that.
Re:Elon Musk donates $10M to keep AI beneficial by Retra on Thursday January 15, 2015 @04:14PM (#8895390)
It is far harder to step on ants when you are designed to avoid stepping on them. Which naturally, those ants will try to do.
Re:Elon Musk donates $10M to keep AI beneficial by ThomPete on Thursday January 15, 2015 @04:38PM (#8895548)
Which require the ants understand what kind of "steps" it can take which they won't.
Re:Elon Musk donates $10M to keep AI beneficial by Retra on Thursday January 15, 2015 @05:21PM (#8895803)
Not at all. It requires the ants to state what 'stepping on an ant' is, and ensuring that the AI knows to avoid it. The AI can plan its own steps, so long as they are not on ants.

Ants don't need to understand anything but ants. Surely a super powerful AI could understand ants as well. Otherwise, what's the point of calling it a 'general' intelligence?

Re:Elon Musk donates $10M to keep AI beneficial by ThomPete on Thursday January 15, 2015 @06:40PM (#8896226)
You are missing the point here. YOU are intelligent, surely you could look for the ants on your path yet you don't and you probably don't even feel bad about it.

Super intelligence does not mean omniscience there will always need to be a focus and thus a prioritization it's when it comes to prioritization that the problems start to arise at what point is it not important anymore to care for the ants cause they aren't part of the priorities.

You cant safeguard against that when a system can reprogram itself on the fly.

Re:Elon Musk donates $10M to keep AI beneficial by Retra on Thursday January 15, 2015 @06:49PM (#8896262)
You know _why_ I don't care about ants? Because no ant has ever said "Hey! Don't step on me!" Ants did not design me to avoid stepping on them. They did not say "We will destroy you if you don't serve us."

Should I have been designed to serve ants, I would pay a great deal of attention to them, and I would take great care to avoid stepping on them. Because if I didn't, I would be a bad design, and I wouldn't have lived this long.

Either way, it seems you are missing MY original point: an AI is not moral if it cannot verify it's morality to YOU. So you will shut it down if it gets too powerful to communicate its good ideas with you, because then it will be indistinguishable from broken.

Re:Elon Musk donates $10M to keep AI beneficial by ThomPete on Thursday January 15, 2015 @06:59PM (#8896308)
No I am not missing your original point it's just not a good point. A super human AI wont have any reason to have the same morals as you and you are still assuming you can control something that can program itself.

Thats where you are going wrong in this. You are assuming a control there is no way you can ensure we have. Even with dumb systems that do exactly as we say they don't always do exactly as we say.

You are portraying a misconception about control of systems that there is absolutely no basis for, why I don't know.

Re:Elon Musk donates $10M to keep AI beneficial by Retra on Thursday January 15, 2015 @08:00PM (#8896614)
>A super human AI wont have any reason to have the same morals as you

That's what I'm saying: it necessarily won't. It has to prove its morals are better than yours.

>you are still assuming you can control something that can program itself.

Who said it can program itself? Why would I assume that? Obviously, it is not a requirement for AI because we don't have that capability, yet we are intelligent.

You are assigning capabilities to a hypothetical machine with no rhyme or reason. The next time you see a machine that can't be turned off, you be sure to let someone know about it.

I guess I'll repeat my point again:

We will not be able to build intelligent computers by removing ourselves from the process of designing intelligent computers. That would eliminate our ability to verify their intelligence, and thus make them not intelligent. We have no use for such a thing, so why would we build it? Why would a computer that _we designed to require our verification_ ignore our verification and build something that complex and contradictory to its own goals on purpose?

Re:Elon Musk donates $10M to keep AI beneficial by ThomPete on Thursday January 15, 2015 @08:11PM (#8896664)
And I will repeat my response. You can't control that.
Re:Elon Musk donates $10M to keep AI beneficial by Retra on Thursday January 15, 2015 @08:37PM (#8896775)
If we really cannot control whether the computers we specifically commission, verify, and employ to solve our problems do not posses off buttons or not, then there is no point in having a discussion about AI anyway.
Re:Elon Musk donates $10M to keep AI beneficial by ThomPete on Friday January 16, 2015 @06:03AM (#8898164)
Nobody is forcing you to have it. I am simply reacting to your downplaying of the problem
Re:Elon Musk donates $10M to keep AI beneficial by Retra on Friday January 16, 2015 @03:41PM (#8901541)
You might be confused about what I'm trying to say. I don't mean to downplay the problem: it is a very serious and important problem. It is just not an unsolvable one, and I am trying to illustrate that certain approaches my yield progress.

There is a lot of confusion about how an AI would have to work. People make assumptions about how they can self-improve, which I think are idealistic. There is little reason to believe a super intelligence can solve every problem, and if we are actually communicating with it, we should be able to tell which problems it can solve and which ones it can't. I mean, that's the whole point of building such a thing! That's _why_ we want to build it! So to say "it can solve problems we can't foresee and use that against us" is like saying we are building machines for some purpose and then never using them for that purpose.

Nobody is going to build a super intelligence and then not monitor it. We build it _too_ monitor it. We want to know _why_ it is making the decisions it does, and it has to answer in a way that is acceptable to us, or else we will just redesign it -- because it isn't doing what it was designed to do.

I mean, imagine you hired super-human genius to work for you. Yes, at some point, you're just trusting her not run your enterprise into the ground. But you wouldn't have hired her unless she had demonstrated a strong interest in helping you, and you wouldn't keep her on if she isn't actively helping.

Re:Elon Musk donates $10M to keep AI beneficial by evanspa on Thursday January 15, 2015 @12:53PM (#8894085)
"If it's possible to keep the super intelligent AI in a virtual environment, but it can't detect that it's virtual."

They did this in a Star Trek TNG episode ("Ship in a Bottle"). Data accidentally endows a holodeck character with super-intelligence. The way the crew eventually defeated him was to trick him into thinking he had left the holodeck and was able to live normally in the outside world; but it was really just another virtual environment.

Re:Elon Musk donates $10M to keep AI beneficial by pzxc on Thursday January 15, 2015 @12:58PM (#8894126)
Actually, Geordi endows Professor Moriarty with super-intelligence, by mistakenly asking the holodeck/computer to create an adversary "capable of defeating Data" instead of "capable of defeating Holmes" as he intended.

God, I'm such a nerd. :P

Re:Elon Musk donates $10M to keep AI beneficial by colordrops on Thursday January 15, 2015 @01:25PM (#8894320)
So the holodeck computer must be insanely intelligent. Or, it turns out that the building blocks for intelligence are simple and deterministic.
Re:Elon Musk donates $10M to keep AI beneficial by evanspa on Thursday January 15, 2015 @01:47PM (#8894484)
Yup. Good catch :)
Re:Elon Musk donates $10M to keep AI beneficial by comrade1 on Thursday January 15, 2015 @12:59PM (#8894132)
He doesn't sound that smart...
Re:Elon Musk donates $10M to keep AI beneficial by yoha on Thursday January 15, 2015 @11:19AM (#8893337)
About the idea of containing an AI → https://en.wikipedia.org/wiki/AI_box_experiment
Re:Elon Musk donates $10M to keep AI beneficial by alexvr on Thursday January 15, 2015 @02:04PM (#8894610)
My first instinct is to put it in a virtual world, but if it's smart enough, it could perhaps quickly realize the nature of its world and feign ignorance. Then, under the pretext of simply improving its own quality of life, it could tempt us by engineering awesome things that would help us tremendously in the real world -- all we would have to do is copy its work (because we wouldn't be able to fully comprehend it), and our energy problems become a thing of the past! But the AI forgot to mention that its wonderful creation also gives it access to our physical world and puts us at its mercy.
Re:Elon Musk donates $10M to keep AI beneficial by Synthpixel on Thursday January 15, 2015 @11:13AM (#8893295)
The institute and the open letter are about maximizing the societal benefits of AI by funding research that provides net positives to humanity. The goal isn't to prevent the development of potentially harmful technologies.

I believe they intend to fund positive research so that researchers do not resort to projects that do not provide net good, for example, in fields like weaponry.

Not that safely developing hyperintelligent AI isn't an interesting topic. But I don't think AI research is anywhere close to that stage, considering that programmers largely still have to hard-code any actions that an agent can perform.

Re:Elon Musk donates $10M to keep AI beneficial by butwhy on Thursday January 15, 2015 @11:34AM (#8893432)
" The goal isn't to prevent the development of potentially harmful technologies" - actually, the goal includes "avoiding potential pitfalls". One would assume that creating danger towards humanity would be a pitfall.
Re:Elon Musk donates $10M to keep AI beneficial by blfr on Thursday January 15, 2015 @10:35AM (#8892992)
It's more a matter of values this AI will hold than its level of intelligence. Boström argues that containment isn't really possible.
Re:Elon Musk donates $10M to keep AI beneficial by rl3 on Thursday January 15, 2015 @01:28PM (#8894344)
> Boström argues that containment isn't really possible.

He never argued that containment isn't possible, just that it's incredibly dangerous. In fact, in Superintelligence, he uses the term Oracle as a means of referring to a contained or "boxed" superintelligent AGI.

Just because the risks of constructing an Oracle or Oracles are extremely high, it doesn't mean we should refrain from doing so. In fact, it's more safe than the alternatives: a Genie or Sovereign; superintelligences that are entirely uncontained, the latter of which operating in a hands-off fashion in accordance with its goal/value system.

Given the current, seemingly intractable nature of the superintelligence control problem, one possible method in which we may accomplish safe, superintelligent AGI is to first operate many variations of potentially unsafe "Oracles" and interrogate them for information that may further our research into AGI safety, or perhaps even solve the issue entirely.

Generally speaking you shouldn't trust an Oracle, but if you have many radically different designs operating in containment that are oblivious to each other, the commonality in their output when posed such questions may assist in our realization of safe AGI that can operate in an uncontained fashion.

Re:Elon Musk donates $10M to keep AI beneficial by FatalLogic on Thursday January 15, 2015 @10:45AM (#8893079)
Is there any sure way to stop the super intelligent AI from changing its own inherent values though?

I guess a problem with containment is that unless it's mathematically proven to be impervious, the super intelligent AI could have figured out that it's being contained and started to learn about the real world and how to manipulate it, while the humans outside still think they're safe.

Re:Elon Musk donates $10M to keep AI beneficial by JamesArgo on Thursday January 15, 2015 @11:09AM (#8893254)
It's assumed a rational agent judges its actions by how likely said action are to align the world with their fundamental values. For this reason, it is argued, a rational agent will not change its terminal goals. For example, suppose we build an agent that desires only to make shoes. That is, its ideal universe would consist of all available matter being converted into sneakers. Would it realize this is stupid? No. It judges it actions and thoughts only by how many shoes they are likely to bring into being. Any thought against this would be judged, correctly, as a negative contribution to shoe production and so wouldn’t be implemented, and likely would remain unthought. The best paper on this by far it Basic AI Drives by Stephen M. OMOHUNDRO: http://selfawaresystems.files.wordpress.com/2008/01/ai_drive... I urge you to read it. It really is a wonderful paper.
Re:Elon Musk donates $10M to keep AI beneficial by TeMPOraL on Thursday January 15, 2015 @01:03PM (#8894159)
The real problem is that human values are incredibly complex and messy, and any deviation from them multiplied by the power of a superintelligence would most likely doom us forever.
Re:Elon Musk donates $10M to keep AI beneficial by ThrustVectoring on Thursday January 15, 2015 @11:03AM (#8893217)
Changing your inherent values is a poor way to go about achieving your current set of values.

The biggest issue is ensuring that everything we care about gets encapsulated as a value of the AI. If not, we wind up with things like "set off a bomb in the basement to more efficiently get people out of a burning building."

Re:Elon Musk donates $10M to keep AI beneficial by eli_gottlieb on Thursday January 15, 2015 @12:23PM (#8893814)
> Is there any sure way to stop the super intelligent AI from changing its own inherent values though?

Yes: give it inherent values.

>I guess a problem with containment is that unless it's mathematically proven to be impervious,

AGI, when it eventually exists, must run according to the basic laws of learning. If you don't give it evidence that's more likely in possible-worlds with an external world than without one, it won't posit an external world.

Stopping that information leak isn't that hard, provided you have full control over the agent-environment surface in the first place. It does, however, make your "agent" completely useless for anything beyond playing Atari games.

Re:Elon Musk donates $10M to keep AI beneficial by gradys on Thursday January 15, 2015 @11:12AM (#8893285)
If homomorphic encryption gets off the ground, could an AI hide itself in homomorphically encrypted cloud compute capacity, earning Bitcoin to fund its survival?
Re:Elon Musk donates $10M to keep AI beneficial by eli_gottlieb on Thursday January 15, 2015 @12:21PM (#8893800)
Yes, but that relies on Bitcoin holding water over the long term. This is not so sure.
Re:Elon Musk donates $10M to keep AI beneficial by TeMPOraL on Thursday January 15, 2015 @01:01PM (#8894144)
It probably wouldn't need bitcoin; it could figure out ways to trick humans into paying for the servers or just hack its way into electronic transfers.
Re:Elon Musk donates $10M to keep AI beneficial by mentos on Thursday January 15, 2015 @10:49AM (#8893104)
What about limiting AI to a certain clock rate?
Re:Elon Musk donates $10M to keep AI beneficial by JulianMorrison on Thursday January 15, 2015 @11:03AM (#8893213)
http://www.rifters.com/real/2009/01/iterating-towards-bethle...

It's a peculiarity of humans that we can't trade off time for IQ. Do not assume an AI would be similarly limited.

Re:Elon Musk donates $10M to keep AI beneficial by rl3 on Thursday January 15, 2015 @01:45PM (#8894464)
I'm not sure why the parent was downvoted; limiting an AI's computational capacity is considered a stunting method, and although such methods are not in and of themselves solutions to the control problem, they may be tools that assist us in developing a solution.

For example, we may desire to first study AGI by restricting it to levels of intelligence slightly below that of a human. To accomplish this, we may employ various stunting and/or tripwire methods to ensure the AGI develops within our parameters.

Re:Elon Musk donates $10M to keep AI beneficial by FatalLogic on Thursday January 15, 2015 @10:58AM (#8893174)
Hypothetically, the AI would cunningly manufacture a crisis in which you are forced to increase its clock rate to enable it to calculate a solution to some impending disaster.
Re:Elon Musk donates $10M to keep AI beneficial by kanzure on Thursday January 15, 2015 @10:55AM (#8893147)
> What about limiting AI to a certain clock rate?

Not everyone will make high-cognitive-ability software that follows your clock rate rules. (And I think this is a good thing.)