News for hackers. Stuff that matters.
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Wednesday December 19, 2018 @05:53PM (#18720699)
I take huge offense to this article. They claim that when it comes to AGI, Hinton and Hassabis “know what they are talking about.” Nothing could be further from the truth. These are people who have narrow expertise in one framework of AI. AGI does not yet exist so they are not experts in it, in how long it will be, or how it will work. A layman is just as qualified to speculate about AGI as these people so I find it to be infinitely frustrating when condescending journalists talk down to the concerned layman. This irritates me because AI is a death scentance for humanity — its an incredibly serious problem.

As I have stated before, AI is the end for us. To put it simply, AI brings the world into a highly unstable configuration where the only likely outcome is the relegation of humans and their way of life. This is because of the fundamental changes imposed on the economics of life by the existence of AI.

Many people say that automation leads to new jobs, not a loss of jobs. Automation has never encroached on the sacred territory of sentience. It is a totally different ball game. It is stupid to compare the automation of a traffic light to that of the brain itself. It is a new phenomenon completely and requires a new, from-the-ground-up assessment. Reaching for the cookie-cutter “automation creates new jobs” simply doesn’t cut it.

The fact of the matter is that even if most of the world is able to harness AI to benefit our current way of life, at least one country won’t. And the country that increases efficiency by displacing human input will win every encounter of every kind that it has with any other country. And the pattern of human displacement will ratchet forward uncontrollably, spreading across the whole face of the earth like a virus. And when humans are no longer necessary they will no longer exist. Not in the way they do now. It’s so important to remember that this is a watershed moment — humans have never dealt with anything like this.

AI could come about tomorrow. The core algorithm for intelligence is probably a lot simpler than is thought. The computing power needed to develop and run AI is probably much lower than it is thought to to be. Just because DNNs are not good at this does not mean that something else won’t come out of left field, either from neurological research or pure AI research.

And as I have said before, the only way to ensure that human life continues as we know it is for AI to be banned. For all research and inquires to be made illegal. Some point out that this is difficult to do but like I said, there is no other way. I implore everyone who reads this to become involved in popular efforts to address the problem of AI.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nradov on Wednesday December 19, 2018 @06:17PM (#18720892)
Stating something more times doesn't make it true. Everything you've written is pure speculation, and alarmist at that. There's no proof that AGI is even possible, and if it is possible there's no proof that it will end humanity.
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by 995533 on Thursday December 20, 2018 @11:46AM (#18726467)
Clearly, AGI-level intelligence is possible, because human brains exist.

So unless you pose that a function has to rely on its materialization (there is something untouchably magic about biological neural networks, and intelligence is not multiple realizable), it should be possible to functionally model intelligence. Nature shows the way.

AGI will likely obsolete humanity. Either depricate it, or consume it (make us part of the Borg collective). Heck, even a relatively dumb autonomous atom bomb or computer virus may be enough to wipe humanity from the face of the earth.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nradov on Thursday December 20, 2018 @01:19PM (#18727473)
It's not at all clear that AGI is technically feasible. Human brains exist but we have only a shallow understanding of how they work.

Even if we assume for the sake of argument that AGI is possible, there's no scientific basis to assume that will make humanity obsolete. For all we know there could be fundamental limits on cognition. A hypothetical AGI might be no smarter than humans, or might be unable to leverage it's intelligence in ways that impact us.

Nuclear weapons and malware can cause damage but there's no conceivable scenario where they actually make us extinct.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by 995533 on Thursday December 20, 2018 @07:00PM (#18730368)
Something can be possible, while still technically not feasible.

I agree our knowledge currently is lacking, but see no reasons why this will never catch up.

There are fundamental limits on cognition. For one our universe is limited by the amount of computing energy available. Plenty of problems can be fully solved, to where it does not matter if you are increasingly more intelligent (beyond a certain point, two AGI's will always draw at chess). Another limit is practical: the AGI needs to communicate with humans (if we manage to keep control of it), so it may need to dumb down so we can understand it.

Even an AGI as smart as the smartest human will greatly outrun us: it can duplicate and focus on many things in parallel. Then the improved bandwith between AGI's will do the rest (humans are stuck with letters and formulas and coffee breaks).

Manually deployed atom bombs and malware can already wreck us. No difference with autonomous (cyber)weapons.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Wednesday December 19, 2018 @07:55PM (#18721573)
Even anti-alarmists don’t ask for proof that AGI is possible. Obviously it is possible. Speculation is the best you get because nobody is going to be able to prove anything. We haven’t proven global warming is caused by humans but it’s still worth it to be proactive about greenhouse gasses. This is because when something is extremely dangerous, you don’t wait around for someone to finish proving it beyond any shadow of a doubt. You probably also think that god exists because nobody can prove otherwise?

And what does alarmist even mean? Do you call global warming advocates alarmists? It’s such an annoying, nonsense word that boils down to name-calling really. Discuss the merits of my actual argument. If you think my speculation is wrong, point out a flaw in the chain of logic that leads to my conclusion. Don’t just wave your hand and say that “you can’t prove it” like some evangelical christian talking about god or global warming. Seriously infuriating when there is so much at stake.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nradov on Thursday December 20, 2018 @01:01AM (#18722809)
I ask for proof that AGI is possible. Show me a computer as smart as a lab mouse and then I'll take your concerns seriously.

The analogy to anthropomorphic global climate change is a non sequitur. Climatologists have created falsifiable theories which make testable predictions.

And you really have no clue about my personal religious beliefs. Calm down and take a seat.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by mindcrime on Thursday December 20, 2018 @02:11AM (#18723044)
I ask for proof that AGI is possible. Show me a computer as smart as a lab mouse and then I'll take your concerns seriously.

I would argue that, unless you can show why AGI is not - in principle - possible, that the null hypothesis would be that it is possible. Unless we veer off into some weird mysticism, it seems that the human brain turns energy and matter into intelligence somehow, operating according to the physical laws of the universe... why shouldn't it be possible to build something else that does the same?

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nradov on Thursday December 20, 2018 @09:22AM (#18725065)
You can't prove a negative. At this point we don't even know what the principles are.

If you're unwilling to provide me with a prototype equivalent to a rodent mind then I'll settle for a fully developed theory of human cognition. Let me know when you've got one. At least that would give researchers some guidelines to know whether they're making forward progress toward AGI.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Thursday December 20, 2018 @03:52AM (#18723409)
I never said anything about your religious beliefs, only that your need for hard proof one way or the other is similar to the need displayed by people who want to believe in god and who dont want to believe in global warming. there are many such examples but the bottom line is that demanding me to show you a sentient computer right now is not reasonable. We have the ability to reason about things without developing formal, mathematic proof about it. And in this case, there is no possibility that anyone could ever prove that AI is possible or impossible. Nobody can prove what it will do. If accept nothing less than hard proof then you are opting out of survival in basically any situation whatsoever. Sometimes logical reasoning is all you have and this is a case of that.

Yeah and before the measurements were done, before enough time had elapsed for meaningful change to be measured, all there was was people like me screaming at people like you, trying to make you see. When ai comes you’ll have your proof but it will be too late.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nradov on Thursday December 20, 2018 @09:38AM (#18725210)
No that's not how it works. Currently a belief in the inevitable arrival of AGI is a secular religious faith with no basis in hard science. We have plenty of real problems to worry about (like anthropomorphic global climate change) before we waste time making public policy to prevent something that may never happen anyway. Your concerns are silly, akin to worrying about an alien invasion when we don't even know if extraterrestrial life exists.
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Thursday December 20, 2018 @01:21PM (#18727503)
You are an outlier. Even Hassabis and Hinton believe that agi is inevitable. I’ve never met anyone who thought otherwise. The only disagreement is about the timescale and the result of its existence. If nothing I’ve said can convince you that ai is possible, then i would just ask you to consider that the human brain exists and that we will eventually figure out how it works.
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by 995533 on Thursday December 20, 2018 @12:09PM (#18726723)
You are correct, in that AI experts may not be the best predictors for AGI. For one, they spend their lives working towards the goal of AGI, so it would require a huge amount of cognitive dissonance for them to say that AGI is impossible or very very far on the horizon.

Philosophers and futurists are better suited to hypothesize an AGI timeline.

But you take it too far by saying it is anyone's game.

Game theory, security, and economic competition makes it impossible to globally ban AI. The incentives to automate the economy (compare AI revolution with industrial revolution) and to weaponize AI (Manhattan Project for intelligence) are just too big. We are already seeing that the US focus on fair and ethical AI puts them at a disadvantage against China and Russia. AGI must require pervasive surveillance of the populace, but the Luddites are holding this back.

I suggest you learn to stop worrying about the bomb, and start planning for its arrival.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by AgentME on Wednesday December 19, 2018 @06:57PM (#18721211)
There are non-doomsday possibilities for AGI. Imagine a super-intelligent AI that was built from the start to value humanity and our way of life, and from there it chooses to protect us and enable us all to do what we want more. (Of course, this could go in dystopian directions, but even those are better than extinction.) A super-intelligent AI that is built to value humans could decide to "uplift" humans' intelligence to be able to keep up with it in places that humans desire to keep up with it.

If we can figure out decision theory and how our values work, then when we figure out AI, we can hopefully build it to be aligned with our values from the start, instead of blindly hoping it happens to play nice with us instead of brushing us off like ants.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Wednesday December 19, 2018 @08:07PM (#18721645)
You don’t even begin to comprehend what I’m saying. You need to think about this more deeply.

So what if it is possible to create a benevolent ai? Nobody said this isn’t possible or even likely. We can also invent a machine that scrubs all the moss off of stones. Just because it’s possible for it to exist doesn’t mean it’s going to proliferate in the free-market of the world and everything in it. The only thing that is important is the fact that

1: we will enter an unstable configuration where any AI implementation that can exist will exist

2: the AI implementations that proliferate will be those that are not hamstrung by being forced to include humans in the loop

3: humans will be out of the loop for every conceivable task and therefore not enjoy the high standard of living that they do in 2018

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by AgentME on Thursday December 20, 2018 @04:18PM (#18729210)
I disagree with points 1 and 2 (and therefore 3). If a friendly AI is built and matures first, then it can protect us from unfriendly AIs trying to mature and take power. (Others call this idea a "singleton".)
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Thursday December 20, 2018 @08:45PM (#18730870)
That’s a really good point.
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by jeremyjh on Wednesday December 19, 2018 @08:20PM (#18721722)
> the only way to ensure that human life continues as we know it is for AI to be banned

Is that because you think banned things do not happen? Even if the thing that is banned could confer a massive advantage to the entities developing it?

I think AGI is unlikely to be a thing in my lifetime, or even my children's. But if I were worried about it, I'd probably focus on developing a strategy to create a benevolent intelligence FIRST, rather than try to prevent everyone else from ever creating one via agreements and laws.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Wednesday December 19, 2018 @08:23PM (#18721736)
I appreciate that you actually suggest a solution. Nobody knows when AGI will come but it could come tomorrow. It could come in 1000 years. No harm in being proactive.

Developing a good ai first is useless because as I have said, the creation of ai enters us into an unstable configuration where bad ai will crop up regardless. Keeping bad ai from existing is infinitely easier when ai does not exist as a technology as opposed to when it’s a turnkey thing.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by sophistication on Wednesday December 19, 2018 @07:55PM (#18721574)
AI is likely simple and won't require much processing power after all, so it will be impossible to ban it because it would imply more regulation and surveillance than what would be sustainable. Also global warming will likely kill us anyhow. The rational conclusion is to enjoy our supermarkets and warm showers as long as they last. They will probably last longer if we deny these threats so as to avoid causing mass panic and nihilism.
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Wednesday December 19, 2018 @08:10PM (#18721661)
We can survive global warming. We can fix it. We can come back from it. We will never come back from ai. It’s not impossible to ban ai. And we would be stupid to assume it’s impossible instead of trying to find out through an effort to save ourselves.
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by alexnewman on Wednesday December 19, 2018 @11:53PM (#18722599)
"These are people who have narrow expertise in one framework of AI." Proof that you don't know who you are insulting
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Thursday December 20, 2018 @12:21AM (#18722694)
I don’t remember insulting anyone. And how is that not true?
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by random314 on Thursday December 20, 2018 @02:06AM (#18723027)
Geoff Hinton is the grandfather of deep learning. Virtually all the modern advancements in AI can be traced back to him and his lab.

What is your track record in AI? It sounds like you have no technical knowledge of AI. For example do you understand the concept of cross entropy loss?

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Thursday December 20, 2018 @03:41AM (#18723362)
Yes, the grandfather of deep learning. This is exactly my point. All the modern advancements in ai have nothing to do with agi.

And by the way I happen to know about both of the subjects of the article.

[dead]
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Thursday December 20, 2018 @08:20PM (#18730755)
the answers to your questions are

1: I never said recent advancements are directly leading to AGI. Not in ML.

2: I don’t hold any contradictory ideas in my head

Your comment is aggressive and unpleasant which is an offense that should get you flagged. I constantly get flagged for making comments like yours because I happen to have an unpopular opinion. I can’t believe I put up with all this for YOUR benefit. Do you think I derive pleasure from trying to make people like you see things clearly?

As I have said so many fucking times, a layman is just as qualified as a ML expert to talk about the impact of AI on the world. Just because someone is an expert in a field that is tangentially related to AGI doesn’t mean a god damn thing. This is not a discussion about modern ML. But just to make it super easy for you to understand, let me put it this way: even if someone here were an expert in every detail of the theory and practical aspects of implementing an AGI, that person still doesn’t know any more than a layman about the consequences of AI. The point that you so annoyingly cling to is like a car mechanic thinking he was the ultimate authority on how cars would impact the world. You don’t have to be a car mechanic to understand and reason about the concept of transportation. Ultimately, the most qualified person to talk about that is an economist or someone. Not you. You don’t have a deeper understanding of the concept of AGI than literally anyone.

It is to the benefit of humanity that you observe the deep, fundamental changes that AGI will cause in the basic economics of human life. Dismissing it as “too far off” or “alarmist nonsense” is irresponsible.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by random314 on Thursday December 20, 2018 @11:37PM (#18731446)
So, according to you, ML is only tangentially related to AGI. Therefore we should listen to you, not ML experts - because you are a layman.

Even if I accept your absurd logic quoted above - how do you explain your contradictory goal of stopping all ML research. All the top AI experts are conducting ML research, which according to you is only tangentially related to AGI.

Going further, no AI researcher has managed to build even something as smart as a rat.

I, therefore conclude that the human race is at a greater danger of being out competed by evolution and chance mutations of chimpanzees and dolphins. These are our real competitors and next position leaders in IQ. We should focus on banning and eliminating chimpanzees and dolphins instead of foolishly protecting them. Why waste time blocking ML research which is only tangentially related to AGI. Let's take the war to www.reddit.com/r/dolphins and www.reddit.com/r/chimpanzees .

No point wasting time on hacker news.

> I can’t believe I put up with all this for YOUR benefit.

Thanks for looking out for my benefit. I will reciprocate by fighting the chimpanzees for YOUR benefit.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Friday December 21, 2018 @12:49AM (#18731648)
Everything in this comment is wrong. Forgive me for not addressing all of it.

The point about the layman is that the actual substance of my argument should be considered rather than my credentials. You think that your knowledge of ML (credentials) gives you the authority to win a debate without actually debating.

I have never called for a ban on the specific research that is currently ongoing in ML. I have called for a ban on all AI research — not because it’s easy or makes a lot of sense but because it seems to be the only solution. I am receptive to new solutions, the absence of which is quite conspicuous in your comments. You are stuck on credentials and nit-picking.

“So according to you, ML is tangential so therefore listen to you”

I literally spelled this out for you in my comment. Are you blind? The fact that ML is not a direct path to AGI is just an asside. Perhaps I should have focused exclusively on your main error so as to not confuse you. Like I said, the impact of AI on the world is an economics question in essence. You don’t need to know anything about how an AGI might work to reason about the economic, strategic, and existential changes that AI as a concept will bring about. It is absolutely true that no amount of knowledge about ML or even AGI will help in any way with that line of inquiry.

“We haven’t made robot rats yet”

This just a permutation of people saying AGI is far off. You don’t appear to be in the camp that thinks AGI is impossible. Therefore this comment is irrelevant because it will come at some point and my argument is primarily about what that will look like, not when it will happen.

It should, by now, be thoroughly clear to anyone who stumbles upon this thread in the future that I am correct. If you want to continue, you can contact me at brian.pat.mahoney - gmail.com

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by ppod on Tuesday December 25, 2018 @09:28AM (#18757533)
For what it's worth, I considered myself pretty undecided about this issue before, but the tone and content of your comments have moved me significantly against your argument.
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by p1esk on Thursday December 20, 2018 @01:52PM (#18727805)
* AI to be banned*

Good luck with that.

Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Thursday December 20, 2018 @02:22PM (#18728126)
So sarcasm is what will save us all?
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by p1esk on Thursday December 20, 2018 @02:28PM (#18728208)
from people like you :)
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Thursday December 20, 2018 @02:57PM (#18728543)
So ai is not a problem in your eyes?
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by p1esk on Thursday December 20, 2018 @04:07PM (#18729130)
no
Re:Geoffrey Hinton and Demis Hassabis: AGI is nowhere close ... by nuguy on Thursday December 20, 2018 @06:46PM (#18730297)
Where in the logic of my argument have I made a mistake?