News for hackers. Stuff that matters.
Re:"We need a pony. And the moon on a stick. By next Thursday." by drzaiusapelord on Wednesday June 04, 2014 @10:16AM (#7845637)
I think in the future people will be perplexed by how sci-fi during this period was absolutely obsessed by the so-called singularity. Its a current fad, accepted by many, but not backed up by anything substantial like a lot of fads from the past. Its a little embarrassing to read some sharp thinkers from the 1970s who fell into cheap counter-culture concepts like astrological signs or shammy Indian gurus or shoddy California-style Buddhism, that often has little or nothing to do with the Buddhavacana source materials.

It really surprises me that we think there's a realistic path to the singularity and that we obsessed about it. Human-like AI is a dead field, or at least dead as far we can tell. We're not even sure how to build it because conceptually we don't even have a grasp on consciousness or cognition.

Then there's the false assumption that we can get to this level before doing things like, say, solving all mental health issues and that it can magically be scaled to super-human speeds. For all we know cognition happens at a certain speed and any attempts past that are troublesome. Look at how easily we suffer from mania and other issues when our natural limiters go haywire.

Singularity prediction is almost a cargo cult. Its weird that so many take it seriously.

Re:"We need a pony. And the moon on a stick. By next Thursday." by cstross on Wednesday June 04, 2014 @11:26AM (#7846095)
Singularity prediction isn't even taken seriously by most formerly-intrigued SF writers these days. (Go google Ramez Naam on the subject. Or me. Or Cory Doctorow.) Best we can probably hope for is better intelligence augmentation/amplification than we've got now.

The reason it's popular is that it plays to some deep eschatological anxieties shared by many people -- and it strikes resonant echoes with Christian millennialism, making it an easy memetic poisoned chalice for anyone who has consciously rejected knee-jerk Christian doctrine but not actually re-evaluated all their composite assumptions and beliefs to drink from.

Re:"We need a pony. And the moon on a stick. By next Thursday." by JamesArgo on Wednesday June 04, 2014 @11:31AM (#7846127)
>Singularity prediction isn't even taken seriously by most formerly-intrigued SF writers these days.

Becoming a science fiction cliche does not reduce the probability of an event occurring.

Edit: retracting the following:

>The reason it's popular is that it plays to some deep eschatological anxieties shared by many people.

This is probably true, but that's not an argument against the feasibility of AI or the extent of its implications. You're saying, "These projections "rhyme" with those of a low-status group, therefore they can't be true."

Re:"We need a pony. And the moon on a stick. By next Thursday." by epistasis on Wednesday June 04, 2014 @11:47AM (#7846244)
> You're saying, "These projections "rhyme" with those of a low-status group, therefore they can't be true."

No, that's not his argument for why it's not true, it's his argument for why the singularity concept persists when it seems that otherwise non-religious people would reject it.

Some of his arguments against an imminent singularity:

http://www.antipope.org/charlie/blog-static/2011/06/reality-...

http://www.antipope.org/charlie/blog-static/2014/02/the-sing...

Re:"We need a pony. And the moon on a stick. By next Thursday." by JamesArgo on Wednesday June 04, 2014 @12:04PM (#7846361)
You're right. It still feels like an unproductive comparison.
Re:"We need a pony. And the moon on a stick. By next Thursday." by JulianMorrison on Wednesday June 04, 2014 @11:46AM (#7846236)
And may increase it.

The entire low level ongoing effort to build a flying car (Terrafugia, Moller, etc) is basically driven by no market and no common sense, but a whole lot of Jetsons.

Re:"We need a pony. And the moon on a stick. By next Thursday." by BrandonMarc on Wednesday June 04, 2014 @01:51PM (#7847055)
At least Terrafugia has a functioning prototype (i.e. it actually flies, rather than a 36-inch tethered hover), as well as orders.

A separate effort which actually makes a bit more sense and has more of a market is the iTec Maverick [1] - more of a flying dune buggy using a parasail as the "wing", but targeting a wholly different market (the Transition is aimed at wealthy pilots in wealthy countries with streets, airports, etc, whereas the Maverick is - in part - aimed at villagers living in remote jungles, far removed from civilization).

--------------------

[1] http://mavericklsa.com/

Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @11:53AM (#7846294)
Well yeah, but welcome to humanity. We're at our best when we do what we dream of, as what's "realistic" and "feasible" is almost always just code for "the same crappy thing that happened yesterday happening again tomorrow because nobody made the effort to change it". Except then someone puts in the effort, fulfills their dreams, and the real world winds up totally different from the expected world in which those people never acted.
Re:"We need a pony. And the moon on a stick. By next Thursday." by mcguire on Wednesday June 04, 2014 @12:24PM (#7846489)
"Becoming a science fiction cliche does not reduce the probability of an event occurring."

I think I'd like to see some statistics on that.

Edit: No really, I'm serious. Actual data on the commonality of some SF idea and the measured likelihood of it would be very cool.

Re:"We need a pony. And the moon on a stick. By next Thursday." by jfoutz on Wednesday June 04, 2014 @01:12PM (#7846783)
Kinda tough to find what's applicable from this list: http://tvtropes.org/pmwiki/pmwiki.php/Main/OverusedSciFiSill...

But there are a few clear standouts. 6. The patently obvious design flaws in a vehicle or weapon system go uncorrected during the entire life cycle of the system in question.

The original humvee had issues with passenger armor back in 2004 - they could have been purchased with the armor but weren't.

13, Computers, when shot, explode as if they had been stuffed full of Roman candles.

The videos of laptop batteries catching fire are pretty sparkly. Not sure how that would actually interact with a gunshot.

25, On-board computers always know exactly how long it will take for the malfunction to blow up the ship.

The Tesla roadster battery stories seem to give warning and force drivers to stop and get out.

31. A robot that can't climb stairs is deployed in an area where stairs are common.

Roomba?

At the very least, we can make an existential argument about sci-fi cliches actually being accurate. I couldn't think of a good way to get historical science fiction cliches. But the thing about the future is it's unknown. some of Jules Verne's stuff worked out, like submarines and travel to the moon, and other stuff didn't, like time travel.

I guess the rational response to "the singularity" is to stick a number on the likelihood of that actually happening - and then getting on with your life.

I think you're thinking about the future in a funny way, you should give Nassim Nicholas Taleb's The Black Swan a read.

Re:"We need a pony. And the moon on a stick. By next Thursday." by dragonwriter on Wednesday June 04, 2014 @12:42PM (#7846604)
> Singularity prediction isn't even taken seriously by most formerly-intrigued SF writers these days.

Which is probably more a statement about its lack of novelty than anything else.

Re:"We need a pony. And the moon on a stick. By next Thursday." by andreyf on Wednesday June 04, 2014 @12:54PM (#7846672)
> Best we can probably hope for is better intelligence augmentation/amplification than we've got now.

That seems as if it can get pretty close to the singularity, and answers a lot of questions about what a super intelligent being's motivations would be.

Re:"We need a pony. And the moon on a stick. By next Thursday." by tmorton on Wednesday June 04, 2014 @01:51PM (#7847052)
> Best we can probably hope for is better intelligence augmentation/amplification than we've got now.

Sounds like we can get the "Captain America" singularity - everyone gets a genius-level IQ, but nothing further.

Re:"We need a pony. And the moon on a stick. By next Thursday." by cdibona on Wednesday June 04, 2014 @12:14PM (#7846424)
And as a side note, Ramez' nexus and crux are decent fiction books in which augmentation takes on a serious role...
Re:"We need a pony. And the moon on a stick. By next Thursday." by gsk on Wednesday June 04, 2014 @06:25PM (#7848805)
I assume it was unintentional. Your last paragraph appears rather opaque to my tired mind.
Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @11:42AM (#7846207)
Meh, I always thought your "Why There Will Be No Singularity" blog post was a pretty accurate prediction. AI will work, but be so piecemeal that the chances of total domination by a superintelligent singleton get quite low. WBE will eventually work (after AI works, most likely), but will trigger lots of social strife and so come into use quite piecemeal itself. Life gets a lot better and a lot weirder but basically just goes on.

Which has the major upside of meaning we'll never have to deal with the Vile Offspring.

By the way, the final component to Rapture of the Nerds didn't seem to have a very good "exam", as I can't imagine the Galactic Authority would never have come up with any way to analyze minds, for instance a sample of human minds, and thus infer the chance that we can coexist as a species without having to run trillions of parallel copies performing very expensive simulations. Hilarious book, other than that, though; it really reminded me how much of a total nerd I am that I understood every single damn word without having to google.

Re:"We need a pony. And the moon on a stick. By next Thursday." by Fuzzwah on Wednesday June 04, 2014 @12:09PM (#7846395)
Is this the blog post you've mentioned?

http://www.antipope.org/charlie/blog-static/2011/06/reality-...

It is titled "Three arguments against the singularity" from June 22, 2011

Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @12:18PM (#7846451)
Yeah, that one. And I didn't bother addressing the "Simulation Argument", since it's unfalsifiable nonsense.
Re:"We need a pony. And the moon on a stick. By next Thursday." by halfcat on Wednesday June 04, 2014 @09:03PM (#7849562)
Unfalsifiable, okay. But why nonsense? (I haven't read it, yet, genuinely interested in your non-hand-waving thoughts).
Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Thursday June 05, 2014 @02:30AM (#7850511)
"Nonsense" in that there's literally no way to ever tell the difference between a "simulation" being run on a computer in some exterior universe and a very real universe whose laws of physics are fundamentally discrete. "Real" is what you can causally interact with, which means that until that exterior universe decides to deliberately talk to us, they are not actually real with respect to us.
Re:"We need a pony. And the moon on a stick. By next Thursday." by halfcat on Thursday June 05, 2014 @07:25AM (#7851317)
Maybe "pointless" is more correct then. "Nonsense" suggests you have a strong opinion on whether we live in a simulation, which as you said, we can't know.
Re:"We need a pony. And the moon on a stick. By next Thursday." by ableal on Wednesday June 04, 2014 @03:07PM (#7847476)
This bit: "What we're going to see is increasingly solicitous machines defining our environment"

reminded me of Jack Williamson's With Folded Hands scenario (from 1947, http://en.wikipedia.org/wiki/With_Folded_Hands )

Re:"We need a pony. And the moon on a stick. By next Thursday." by DanBC on Wednesday June 04, 2014 @12:25PM (#7846491)
> Meh, I always thought your "Why There Will Be No Singularity" blog post was a pretty accurate prediction. AI will work, but be so piecemeal that the chances of total domination by a superintelligent singleton get quite low.

Oh god - domination by the mediocre AI bureaucrat sounds worse than the AI overlord.

Re:"We need a pony. And the moon on a stick. By next Thursday." by davidgerard on Thursday June 05, 2014 @07:26AM (#7851322)
In the future, cyborg personality emulations embodying immortal human minds will still behave like arseholes towards each other.
Re:"We need a pony. And the moon on a stick. By next Thursday." by JamesArgo on Wednesday June 04, 2014 @10:58AM (#7845894)
As far as I can tell, the claims of the Singularity are as follows:

Human-level AI is possible.

Human-level AI will likely be practical this century.

Once AI is sufficiently advanced, it will be capable of AI research.

Most terminal goals would lead to intelligence enhancement as a sub goal, as any system with a goal would be better able to pursue it if more intelligent. Therefore, most AIs will devote resources to increasing their intelligence.

Assuming humans are not near the maximum possible intellectual level, super-human AI will likely be developed soon after an AI is created that is as smart as the smartest human.

This means the future will not be controlled by humans, as we will no longer be the smartest things in town.

Unless we can predict the goals of the AI, we should consider the future unpredictable after the point of its creation, as our models of the future rely on human-shaped agents with human goals and capabilities. With these assumptions broken, we have a sort of singularity, a breakdown of our models of the future.

It's quite conjunctive, but this all seems pretty reasonable to me - and it's worth spending resources studying.

Re:"We need a pony. And the moon on a stick. By next Thursday." by worldsayshi on Wednesday June 04, 2014 @11:11AM (#7845992)
This idea of singularity relies on the assumption that intelligence scales easily. If we have a machine that is more intelligent than the average human, or even more intelligent than the most intelligent human. Will it be more intelligent than a group of intelligent people? How many? If you have an AI running on a supercomputer that is more intelligent than the most intelligent human you might still need a few billion supercomputers to outmatch the human race.
Re:"We need a pony. And the moon on a stick. By next Thursday." by ufmace on Wednesday June 04, 2014 @01:56PM (#7847076)
What messy about this is figuring out exactly how to define intelligence, and what it really means to be more intelligent than someone. If somebody said that an AI was more intelligent than the most intelligent human, then how would you figure out if that was true? If it was true, what exactly would this AI be able to do that the human couldn't do?

How does a difference in the level of intelligence of a particular entity compare to the effective intelligence of having lots of less intelligent entities? Having lots of people means that you can apply intelligence towards a lot of tasks, but perhaps all of them together will never come up with something that a greater intelligence could come up with.

Thinking about it, it seems to me that you have to apply it against an actual difficult task. Take a task like "build a power-producing fusion reactor" that nobody knows how to do yet. Would we be able to figure out how to do that faster if there was some superior intelligence applied to it? Or does the huge number of engineering problems associated with building such a thing respond better to a large number of more ordinary intelligence?

Re:"We need a pony. And the moon on a stick. By next Thursday." by baddox on Wednesday June 04, 2014 @01:08PM (#7846750)
It's only one data point, but observe how much more intelligent humans are than the next most intelligent species on Earth.
Re:"We need a pony. And the moon on a stick. By next Thursday." by worldsayshi on Friday June 13, 2014 @09:08AM (#7888590)
We are much more intelligent because we have efficient ways to interchange information. It allows us to use our collective intelligence. Our singular intelligence isn't that much more evolved. ("Intelligence is in our language")

Sorry for reviving old thread.

Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Thursday June 05, 2014 @02:58AM (#7850590)
And observe how large our brains have to be to achieve that, and how many calories it requires.
Re:"We need a pony. And the moon on a stick. By next Thursday." by _archon_ on Thursday June 05, 2014 @10:43AM (#7852185)
I don't understand how this is relevant to the conversation at hand. I had assumed that we were discussing this topic with the assumption that we can make full use of first world resources, so we should have a capable, (mostly) reliable power source, food, materials, etc. readily available.
Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @11:24AM (#7846084)
This assumes that a single greater-than-human AI doesn't figure out how to get humans onto its side. Given that it will not be a cartoon supervillain, that task will actually be incredibly easy: find ways to give humans what they want in exchange for doing what the AI wants.
Re:"We need a pony. And the moon on a stick. By next Thursday." by worldsayshi on Wednesday June 04, 2014 @11:38AM (#7846175)
Sure, then it will become just another productive person/citizen. We work together because we benefit from it. Working against another intelligent being is significantly harder in the long term.

edit: And the collective is significantly more intelligent than the individual (for some but definitely not all reasonable definitions of intelligent and collective).

Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @11:44AM (#7846223)
>Sure, then it will become just another productive person/citizen.

Only in the sense that Stalin or Pinochet was a productive citizen. Powerful people can mobilize others to their own ends without those ends being at all good or moral for everyone who is not so mobilized.

Re:"We need a pony. And the moon on a stick. By next Thursday." by BEEdwards on Wednesday June 04, 2014 @01:49PM (#7847043)
You can disagree with his methods, but saying Stalin wasn't productive is just plain wrong.

From agrarians to victors of ww2 in ~20 years is pretty impressive by any measure.

Re:"We need a pony. And the moon on a stick. By next Thursday." by malka on Wednesday June 04, 2014 @11:12AM (#7845995)
> Human-level AI is possible.

> Human-level AI will likely be practical this century.

Both are unknown.

Re:"We need a pony. And the moon on a stick. By next Thursday." by JamesArgo on Wednesday June 04, 2014 @11:21AM (#7846059)
>Human-level AI is possible.

Well we exist, so we know human-level intelligence can be implemented in physics. So we certainly know AI is possible.

Re:"We need a pony. And the moon on a stick. By next Thursday." by sampo on Wednesday June 04, 2014 @11:28AM (#7846106)
I agree to that. But the question of whether human-level I is capable of designing human-level AI remains open still.
Re:"We need a pony. And the moon on a stick. By next Thursday." by e12e on Wednesday June 04, 2014 @01:24PM (#7846875)
Well, design is a slippery word. We are capable of producing children that grow up to be intelligent.

In fact, I think it is quite clear that we are capable of designing systems that are more intelligent than an unaided human (or even group of humans). One of the first such systems were writing. I also tentatively claim that new means of recording and arranging knowledge (which we do today by means of computers) is another step towards superhuman intellect in the strictest sense of "more than mere human".

I think it is an open question what will come out of our playing with genes directly. I certainly expect we'll able to produce some change in the human condition, I hope some of that change will be for the "objectively" better. I have no idea if it will directly impact our intelligence.

Re:"We need a pony. And the moon on a stick. By next Thursday." by baddox on Wednesday June 04, 2014 @01:15PM (#7846806)
Even if we never figure out a formal computational design for human-level AI, I find it hard to believe that we wouldn't be able to achieve the same ends with genetic engineering and computer interfaces to biological computers (i.e. brains).
Re:"We need a pony. And the moon on a stick. By next Thursday." by dragonwriter on Wednesday June 04, 2014 @12:49PM (#7846645)
> I agree to that. But the question of whether human-level I is capable of designing human-level AI remains open still.

"Designing" isn't necessary for creating (OTOH, whether we can artificial select for it and avoid selecting for dead ends may be an issue.)

Re:"We need a pony. And the moon on a stick. By next Thursday." by sampo on Wednesday June 04, 2014 @01:05PM (#7846731)
You are correct. But it's not 100% certain whether we would be capable of setting up a world simulation that would create intelligent agents of the human level. And much less certain, (1) are we able to set up such simulation in the next couple of centuries, and (2) will the simulation produce these intelligent agents after having been running for only a couple of centuries (wall clock time).

Btw, Crystal Nights by Greg Egan is a fascinating short story: http://ttapress.com/553/crystal-nights-by-greg-egan/

Re:"We need a pony. And the moon on a stick. By next Thursday." by malka on Wednesday June 04, 2014 @11:25AM (#7846088)
Playing a little bit devil advocate here ;)

We have no mean to know. Maybe the subjective experience is an inherent part of our intelligence, and not just a side effect. And I do not see any way of applying the scientific method to the subjective experience.

Nethertheless, I really hope that the future will prove me wrong.

Re:"We need a pony. And the moon on a stick. By next Thursday." by sampo on Wednesday June 04, 2014 @11:48AM (#7846254)
Please correct if I'm wrong, but sounds like you think human intelligence requires something outside of known physics, something "magical", to work?
Re:"We need a pony. And the moon on a stick. By next Thursday." by malka on Wednesday June 04, 2014 @12:25PM (#7846493)
I'm agnostic about this question. We do not have the necessarry tools to answer right now. One possible way I can see to do that would be to map a human brain neuron by neuron and simulate it. We are not here yet.
Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @11:06AM (#7845954)
That assumes AIs can enhance their intelligence given fixed computational resources. We don't actually know the shape of the curve for optimization power on the X-axis and necessary FLOPs on the Y-axis. If it's anything larger than linear, AIs will not self-improve in a "singularity" type fashion, but in fact hit a point of severely diminished returns relatively quickly. Judging by the computational complexity of machine-learning algorithms, it's actually entirely possible that curve is exponential (meaning that AGI is DEXPTIME-complete), in which case the only question is how far we are towards the diminishing-returns point.
Re:"We need a pony. And the moon on a stick. By next Thursday." by ThrustVectoring on Wednesday June 04, 2014 @12:06PM (#7846375)
This objection further assumes that the end-point after consuming all low-hanging fruit is a pre-singularity level AI. If a self-improving AI runs into algorithmic limits only after figuring out how to turn the solar system into computronium, that's still worth calling a "singularity".
Re:"We need a pony. And the moon on a stick. By next Thursday." by baddox on Wednesday June 04, 2014 @01:13PM (#7846786)
Does the singularity concept actually require some sort of quickly growing or even asymptotic curve for intelligence improvement? I don't see why that would be a requirement. Even if AIs are only slightly more intelligent than humans, it seems like many of the effects associated with the singularity could occur. If AIs were more intelligent than humans to the same extent humans are more intelligent than the next most intelligent species on Earth, surely we would consider that to resemble the proposed singularity.
Re:"We need a pony. And the moon on a stick. By next Thursday." by viraptor on Wednesday June 04, 2014 @11:12AM (#7846001)
But that assumes running AI on some architecture where FLOPs have any real meaning. If we grow an AI that's externally accessible, is that less of an achievement than simulating the same on a general purpose computer? Still assuming it could achieve singularity that is...
Re:"We need a pony. And the moon on a stick. By next Thursday." by webmaven on Wednesday June 04, 2014 @02:01PM (#7847101)
Except that we already have examples of semi-autonomous non-AGI software that successfully acquires additional computational resources via parasitism.

Further, beyond the task of software improvement, the task of improving hardware is itself already heavily software-mediated when performed by humans, and will likely be a prime candidate for applying pre-AGI AI.

There are likely other ways to attack the problem, such as not focusing on hardware improvements per-se, but instead on the cycle time for getting the improvements deployed (eg. somehow eliminating or cutting the size/cost/construction time of new Fabs).

Re:"We need a pony. And the moon on a stick. By next Thursday." by sampo on Wednesday June 04, 2014 @11:16AM (#7846029)
> Human-level AI will likely be practical this century.

Given how far away from that goal we are now, after 85 previous years of research, I would not hold my breath for reaching that goal in the next 85 years.

Re:"We need a pony. And the moon on a stick. By next Thursday." by saalweachter on Wednesday June 04, 2014 @12:05PM (#7846366)
While I'm in the camp of "people who say 'X will happen in the next Y years' are really saying 'X will happen before I die'", I think it is unreasonable to treat the last 50-85 years as a failure for AI.

There are two things holding back AI (which from a singularity-standpoint just means "a machine capable of general problem-solving", and not "a machine possessing the ineffable characteristics of human consciousness"). First, we don't know how. Second, we might not have the computational capacity.

While we still don't know how, the bar is getting lower and lower as time goes on. Increasing computational capacity means that we can start with worse and worse initial versions of a general intelligence. Maybe a really special genius could write a general problem solver which ran on a 386 (even if it lacked the self awareness to feel the pain of running on a 386). Maybe we're too dumb to ever write a general problem solver even if we had an infinately fast computer with unlimited memory.

But even if programmers have made no progress since the 1960s, we are definitely not in the same position.

Re:"We need a pony. And the moon on a stick. By next Thursday." by mcguire on Wednesday June 04, 2014 @12:53PM (#7846660)
"While I'm in the camp of "people who say 'X will happen in the next Y years' are really saying 'X will happen before I die'"..."

That depends on who is saying it. I've noticed that when actual researchers say, "We hope this will provide a treatment for reticularly homicidal brain-worms within 5 years", they mean they have no idea if or when any such practical material benefits will appear. If they say, "We will be able to get effectively unlimited amounts of energy from russet potatos within 20 years," they mean they don't believe it's ever going to happen.

If the difficulty is exponential, as I rather expect it to be (in my own completely unfounded opinion), then lowering the bar a given amount doesn't help much. And as far as increasing computational capacity goes, we're already deep into the realm where communication costs outweigh actual computational costs, which makes it a whole different ball game going forward.

If you want a further speculation, I suspect that modern statistical methods like those behind th' Goog, self-driving cars, and what-not will not get too much closer to a super intelligence than conventional heuristic search. They're capable of doing a lot of things easily, that only humans could do heretofore, but they're not actually more powerful. So, "a machine capable of general problem-solving" is easily conceivable in the same sense that you are capable of general problem solving, but I can't see a singularity on the other side of that.

Re:"We need a pony. And the moon on a stick. By next Thursday." by TeMPOraL on Wednesday June 04, 2014 @02:20PM (#7847220)
Relevant xkcd: http://xkcd.com/678/.
Re:"We need a pony. And the moon on a stick. By next Thursday." by yellowapple on Wednesday June 04, 2014 @01:06PM (#7846738)
> (even if it lacked the self awareness to feel the pain of running on a 386)

Now we know the real motivation behind pretty much every sci-fi storyline involving AI revolts.

Re:"We need a pony. And the moon on a stick. By next Thursday." by e12e on Wednesday June 04, 2014 @01:37PM (#7846965)
2014-2*85=1860 -- so I take it your statements means that discovering AI in the next 85 years would be a bigger change/achievement than the changes we see in the world today from the world of 1929, that was founded on work started in 1860?

So, having a look at wikipedia, we find: "Inspired by Babbage's difference engine plans, Per Georg Scheutz built several difference engines from 1855 onwards, one of which was sold to the British government in 1859." -- that's very convenient. We can cheat a little, and say that in 1929, there'd been about 86 years worth of research into computing -- and so by extension, achieving AI by 2100 is a greater feat than the NSAs new data center was as seen from 1929?

Perhaps. Makes for some interesting thought experiments.

Re:"We need a pony. And the moon on a stick. By next Thursday." by baddox on Wednesday June 04, 2014 @01:17PM (#7846815)
How do you even quantify "how far away from that goal we are now"? Do you have a percentage?
Re:"We need a pony. And the moon on a stick. By next Thursday." by xaa on Wednesday June 04, 2014 @10:38AM (#7845770)
You are right that you won't see many researchers publicly talking about human-level AI, or framing their research in terms of the search for general AI. But that doesn't mean the field is "dead".

For example, I work in aging and, to a lesser extent, neuroscience. I have had many private conversations with researchers who will candidly say that the long-term goal of their work is lifespan extension or cognitive enhancement. Yet, for the purposes of grant and paper-writing, you'd never write such a thing; it would sound too speculative.

I'm not in AI, but I strongly suspect the same thing is going on there. There are probably a lot of AI researchers who want to see human-level or higher general AI happen, and are working on it, but simply can't say so in public. We know it's possible, since we have an existence proof in the human brain.

Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @11:14AM (#7846013)
>For example, I work in aging and, to a lesser extent, neuroscience. I have had many private conversations with researchers who will candidly say that the long-term goal of their work is lifespan extension or cognitive enhancement. Yet, for the purposes of grant and paper-writing, you'd never write such a thing; it would sound too speculative.

I think it was Scientific American or another such magazine that ran a story, maybe a month and a half ago, in which they interviewed a whole bunch of real theoretical and computational neuroscientists about mind uploading. A not-that-small portion of these admitted that when they are in private, have had a drink or two, and are ready to admit things they would never say in a grant application, they are definitely trying to achieve whole-brain emulation.

Hell, it's basically the implicit point of the Human Brain Project, or whatever those initiatives are called by the US and EU governments this past year.

> You are right that you won't see many researchers publicly talking about human-level AI, or framing their research in terms of the search for general AI. But that doesn't mean the field is "dead".

Indeed. What instead happened is that actual humanlike cognition has been steadily broken down into subproblems and each subproblem is being formalized and worked-on separately. There are a few papers on optimal utility-maximizing agents for general environments, but those tend to require "until the stars burn out" levels of FLOPs to work anyway.

So actually, AI is going to work, but by the time it does, it won't be called AI. In fact, the researchers who'll create it would look at you funny for calling it AI. They do and will have lots of academic jargon used for specifying exactly what their algorithms do and how they do it, so much so that only when their algorithm kills all humans will anyone actually admit it was artificial intelligence ;-).

Re:"We need a pony. And the moon on a stick. By next Thursday." by michaelt on Wednesday June 04, 2014 @11:55AM (#7846302)

  I think it was Scientific American or another such 
  magazine that ran a story, [...] real theoretical and 
  computational neuroscientists [...] admit things they 
  would never say in a grant application, they are 
  definitely trying to achieve whole-brain emulation.
Another possibility is they're actually working on the things their grant applications say, but when pushed and offered drinks by journalists looking for a story, they'll extrapolate their research far enough to reach something cool-sounding.

For example, if I'm researching image correlation techniques, which have applications in machine vision, which has applications in obstacle detection and tracking, which has applications in self driving cars, I could tell a journalist that I'm working on image processing techniques with potential applications in self driving cars.

Is that me admitting things I would never say in a grant application, that I'm trying to achieve self-driving cars? Or am I working on exactly what my grant application says, but I've simplified it and added context because I know Scientific American isn't going to be publishing articles about efficient convolving and fast fourier transforms any time soon?

Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @12:15PM (#7846430)
Frankly, I think the real answer is "both", but that might just be my optimism about the... let's call it soulfulness of most scientists. To me it seems as though one would be nuts to keep up in academic science just for the sake of the boring, tiny, insignificant bullcrap one writes in grant applications to sound impressive; to me it seems as if a scientist must have some actual dream burning in him that keeps him going.

On the other hand, my real-world observations say that for many scientists, the burning dream heating their blood and getting them up in the morning to deal with all the bullshit is... careerist ego-stroking.

So on further reflection, ugh.

Re:"We need a pony. And the moon on a stick. By next Thursday." by sampo on Wednesday June 04, 2014 @11:22AM (#7846062)
> they are definitely trying to achieve whole-brain emulation

Of course they are trying.

They were also trying in 1956: "We think that a significant advance can be made in one or more of these problems if a carefully selected group of scientists work on it together for a summer."

http://en.wikipedia.org/wiki/Dartmouth_Conference

The history of AI research is full of totally unfounded optimism that has failed every time. (I mean the kind of research that promises significant advances towards human level AI. Of course AI research has produced methods that have useful applications.)

Re:"We need a pony. And the moon on a stick. By next Thursday." by MaysonL on Wednesday June 04, 2014 @04:37PM (#7848066)
How long ago would realtime auditory language translation have been considered obviously strong AI?
Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Thursday June 05, 2014 @02:35AM (#7850525)
That's basically where my theory about all this comes from. We keep finding that more and more tasks that "clearly" require a whole human-level mind... can actually be done quite well with Narrow AI/ML techniques and crap-tons of training data. We consistently overestimate the Kolmogorov complexity of human cognitive tasks in order to flatter ourselves, thinking that surely no computer can do XYZ unless we're within six months of a capital-S Singularity.

Gaaah, I'm trying to remember the link to some short story that Someone (we all know who) wrote about a man fretting over his JRPG party members seeming to be conscious. The author's afterword said that he expected seemingly-conscious video game characters to show up "six months before the Singularity". I currently expect seemingly conscious video-game characters - which are actually just very stylish fakes with really good NLP - many decades before anyone manages to produce a self-improving agent.

Re:"We need a pony. And the moon on a stick. By next Thursday." by davidgerard on Thursday June 05, 2014 @07:28AM (#7851328)
You could say the same thing about "nanotechnology" - which in practice is materials scientists getting money for chemistry when they know damn well that using the term is implicitly promising magical tiny robots to the gullible.
Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @11:26AM (#7846090)
I find it strange that you think AI and WBE are the same thing. Putting your claims about machine cognition (which can then be separated into various cognitive faculties) aside, you really think that emulating human cognition on a separate substrate is outright impossible? Then what's the seemingly "magical" property of our meat substrate that forbids outright, or forbids via excessive expense, using any other substrate ever?
Re:"We need a pony. And the moon on a stick. By next Thursday." by sampo on Wednesday June 04, 2014 @11:39AM (#7846184)
> you really think that emulating human cognition on a separate substrate is outright impossible?

Absolutely not.

But I think it's too far in the future, that it is totally pointless for us, in 2014, to worry about it.

I view the singularity crowd as a bunch of medieval alchemists, after they have seen gunpowder, worrying about mutually assured destruction of the whole world, after someone scales their firecrackers to a size capable of destroying whole countries.

Yes, coming to 1950's we did reach nuclear weapons with end-the-world capability.

But it would have been quite pointless for (al)chemist, or philosophers, in the 1400's, or even in the 1700's, to start worrying about this threat.

Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @11:47AM (#7846245)
Ah, so you think scientific progress proceeds not merely at a constant rate, but at a constantly slowing rate, thus causing the rate of new discoveries to be roughly constant over the centuries, despite our constantly adding more scientists, and publishing more papers, based on increasingly solid foundations.
Re:"We need a pony. And the moon on a stick. By next Thursday." by sampo on Wednesday June 04, 2014 @11:57AM (#7846318)
> so you think scientific progress proceeds not merely at a constant rate, but at a constantly slowing rate

No, I don't think so.

I just think the way looks very long, even given our current acceleration rate. Plus, this field has a very strong track record of blatant overestimations.

Re:"We need a pony. And the moon on a stick. By next Thursday." by sampo on Wednesday June 04, 2014 @11:43AM (#7846217)
> I find it strange that you think AI and WBE are the same thing.

I apologize but being ambiguous. I don't think they are the same. But I see the same totally unfounded optimism in both the people who expect AGI to happen relatively soon, and in the people who expect WBE to happen relatively soon.

Like, in the next 50–100 years.

Re:"We need a pony. And the moon on a stick. By next Thursday." by davidgerard on Thursday June 05, 2014 @07:29AM (#7851329)
And that they are frequently the same people.
Re:"We need a pony. And the moon on a stick. By next Thursday." by mcguire on Wednesday June 04, 2014 @12:30PM (#7846535)
"...but by the time it does, it won't be called AI."

That is the historical nature of artificial intelligence: it's only AI until you know how to do it reasonably well.

Edit: See https://news.ycombinator.com/item?id=7845803

Re:"We need a pony. And the moon on a stick. By next Thursday." by JulianMorrison on Wednesday June 04, 2014 @11:48AM (#7846257)
Point them at SENS Research Foundation, if they haven't already heard of it.
Re:"We need a pony. And the moon on a stick. By next Thursday." by xaa on Wednesday June 04, 2014 @05:59PM (#7848669)
Funny you mention that. I just came back from this year's AGE conference in San Antonio, which is very much a mainstream research conference, and not only was it partially sponsored by SENS, but de Grey himself was there.

So yes, they are very much aware of it. I think many aging researchers have a love/hate relationship with SENS, in that they share its goals in theory, but are afraid its ambitious public claims will draw disrepute (and associated loss of funding) upon the field.

You have to remember that we are mostly funded by the NIH, whose mandate is to treat disease, and aging is not widely considered a disease. So we have to frame our discourse accordingly.

Re:"We need a pony. And the moon on a stick. By next Thursday." by JulianMorrison on Wednesday June 04, 2014 @07:15PM (#7849087)
De Grey himself seems to take the approach: "we are working on regeneration medicine that will cure each particular, nameable thing that is wrong with old people, and when you have done all of that, there is nothing left to call aging." Thus the NIH problem is side stepped.
Re:"We need a pony. And the moon on a stick. By next Thursday." by xaa on Wednesday June 04, 2014 @10:02PM (#7849783)
He has definitely moderated his tone in the past few years, and has implicitly acknowledged that the specific program he outlined in his book may have been an oversimplification.

But still, you have to be a bit more subtle with grant reviewers than that. "Age-associated disease" is a common catchphrase. For best results, the emphasis has to be on the disease rather than on the aging (even you happen to believe, as I do, that aging is a common root of many diseases).

Re:"We need a pony. And the moon on a stick. By next Thursday." by rayiner on Wednesday June 04, 2014 @10:43AM (#7845803)
> Human-like AI is a dead field, or at least dead as far we can tell. We're not even sure how to build it because conceptually we don't even have a grasp on consciousness or cognition.

The current optimism around A.I. is the result not of real advances in the field, but the very useful outcomes that arise from doing pattern matching and machine learning on big data sets. When people can type "weather today" into Google and get a little card that shows the weather in Philadelphia today, it's hard not to be impressed, not realizing that these tricks don't bring us closer to "real A.I."

As a counter-example, take something very simple like search-and-replace. Word processors have had this function for decades, and it hasn't gotten any better. How long will it be before I can tell my word processor to replace all occurrences of {singular proper noun phrase} with {plural proper noun} and shoot it off to my boss without double-checking each replacement?

Re:"We need a pony. And the moon on a stick. By next Thursday." by xaa on Wednesday June 04, 2014 @11:02AM (#7845920)
I think it's a little deeper than that. During the '70s and '80s heyday of AI, the focus was on mechanisms that would mimic high-level aspects of human cognition: A* search, Prolog, and so on. The overall approach at the time was top-down, and focusing on deterministic algorithms.

I think what we have learned in the interim is not just that "machine-learning" style approaches are successful at specific tasks, but also that a statistical, data-driven, "bottom-up" approach is going to need to be an integral part of any eventual general AI solution. Whether we will need to explicitly design the high-level cognitive elements, or whether they will emerge from properly constructed low-level elements, remains an open question.

Another very important advance since the 70s/80s is the widespread realization that every major aspect of cognition is essentially probabilistic. People have realized that a search for "exact" or "optimal" solutions to problems with the complexity seen in the real world is a futile task because of the high dimensionality of these problems.

Re:"We need a pony. And the moon on a stick. By next Thursday." by Anderkent on Wednesday June 04, 2014 @10:57AM (#7845879)
> Human-like AI is a dead field, or at least dead as far we can tell. We're not even sure how to build it because conceptually we don't even have a grasp on consciousness or cognition. >Then there's the false assumption that we can get to this level before doing things like, say, solving all mental health issues and that it can magically be scaled to super-human speeds. For all we know cognition happens at a certain speed and any attempts past that are troublesome.

On a purely physical level, this is hard to believe. We don't have precise models of consciousness and reasoning, but the general ones (bayesian reasoning, decision theories, etc) are speed-agnostic. It's hard to imagine one that isn't.

> Look at how easily we suffer from mania and other issues when our natural limiters go haywire.

Sure, our hardware sucks. Plus, that's even more the reason to worry about the singularity - if a very fast ai can think and plan, but suffers from mania, that's not a very good outcome. UFAI is an area of concern for many.

Re:"We need a pony. And the moon on a stick. By next Thursday." by mikeash on Wednesday June 04, 2014 @10:35AM (#7845742)
I'm pretty sure that the whole Singularity bit in this piece is sarcastic. That's kind of the whole theme of the article. I mean, this should tip you off pretty hard: "Well now, here's the thing: automating sarcasm detection is easy. It's so easy they teach it in first year computer science courses; it's an obvious application of AI."
Re:"We need a pony. And the moon on a stick. By next Thursday." by mej10 on Wednesday June 04, 2014 @10:42AM (#7845800)
Human-like AI isn't necessary for singularity events, especially the ones that end up killing all of us.

We don't need to understand consciousness or cognition to create optimization processes that end up hurting (or killing) humanity.

It surprises me how many people seem ignorant of this fact.

Re:"We need a pony. And the moon on a stick. By next Thursday." by droopyEyelids on Wednesday June 04, 2014 @10:58AM (#7845889)
What makes me so frustrated about this argument is that we already live in a world with thousands of optimization processes that end up hurting or killing humanity. Everything from the flu to tigers. Plus, all those 'processes' are evolving through selective pressure.
Re:"We need a pony. And the moon on a stick. By next Thursday." by mej10 on Wednesday June 04, 2014 @11:05AM (#7845944)
Corporations, governments, political systems, and other organizations are also optimization processes. Some of which are certainly harmful and also already hurt many people.

And these are evolving through selective pressures as well. And not generally in the pro-humanity direction, more in the "preserve self at all costs" direction.

Re:"We need a pony. And the moon on a stick. By next Thursday." by eli_gottlieb on Wednesday June 04, 2014 @11:50AM (#7846277)
>What makes me so frustrated about this argument is that we already live in a world with thousands of optimization processes that end up hurting or killing humanity.

Yes, we've noticed. Those are evil, too.

Re:"We need a pony. And the moon on a stick. By next Thursday." by mcguire on Wednesday June 04, 2014 @01:03PM (#7846722)
I think you're misunderstanding the use of the term "singularity". It does not mean "X will happen, after which we won't be in charge", or "...after which we'll be dead".

Instead, it means that something will become so intelligent that it will be different in kind, in somewhat the same way that we are so different from gravel that gravel cannot hope to understand our behavior.

An optimization process that ends up killing all of us is bad, but it's not a singularity.

Re:"We need a pony. And the moon on a stick. By next Thursday." by VLM on Wednesday June 04, 2014 @10:27AM (#7845697)
Singularity talk by fictional-ish writers is just a cheap search and replace job done by people who want to talk about their theories of a monotheistic God Version 2.0 and don't want historical baggage and automatic knee jerk reactions from the version 1.0 crowd.

An even better theistic analogy for the singularity is the return of Jesus. Just wait till he comes and rights all the wrongs and banishes death and knows everything about everyone who ever lived and makes a paradise on earth for the true believers ... wait was I talking about the singularity or Jesus again?

(note that I'm not (intentionally) making fun of either subject, but trying to focus on the crude search and replace aspect of the analogy)

Re:"We need a pony. And the moon on a stick. By next Thursday." by mistakenot on Wednesday June 04, 2014 @12:25PM (#7846497)
I've long thought that the singularity is the tech version of the rapture.
Re:"We need a pony. And the moon on a stick. By next Thursday." by T-A on Wednesday June 04, 2014 @07:44PM (#7849206)
You may enjoy reading this then: http://craphound.com/rotn/download/
Re:"We need a pony. And the moon on a stick. By next Thursday." by davidgerard on Thursday June 05, 2014 @07:35AM (#7851339)
Atheist who can't quite get rid of religious fear? Why reinvent Jesus when you can reinvent Yahweh! http://rationalwiki.org/wiki/Roko%27s_basilisk
Re:"We need a pony. And the moon on a stick. By next Thursday." by sspiff on Wednesday June 04, 2014 @10:54AM (#7845857)
Regardless of whether or not you belief in a singularity theory, it's only mentioned in passing in the article and not really relevant to this discussion.
Re:"We need a pony. And the moon on a stick. By next Thursday." by aristus on Wednesday June 04, 2014 @10:31AM (#7845718)
Whatever it is we're grasping toward, it may be "artificial intelligence" only in the sense that a car is an "iron horse".
Re:"We need a pony. And the moon on a stick. By next Thursday." by VLM on Wednesday June 04, 2014 @10:49AM (#7845827)
Trying to make a really good model bird held back the development of flight for centuries.

Certainly, Julius Caesar or Crassus could have afforded a Roman era hot air balloon or hang glider or glider aircraft if this false analogy hadn't stood in the way of development. Performance would have been somewhat lower than modern material craft, but probably not as bad as you think. There were several decades of modest performance aircraft before titanium, synthetic fabrics, and carbon fiber.

AI workers might be more successful in the long run if they focus on making a useful martian brain, not clone humans in silicon.

Re:"We need a pony. And the moon on a stick. By next Thursday." by dragonwriter on Wednesday June 04, 2014 @12:53PM (#7846664)
> AI workers might be more successful in the long run if they focus on making a useful martian brain, not clone humans in silicon.

AI has been a diverse field for a long time, with many different paths -- both with direct biological inspiration (often not human -- including, e.g., insect-inspired approaches) and without are common. Its not an exclusive "human or not human" modelling choice.

Re:"We need a pony. And the moon on a stick. By next Thursday." by jp555 on Wednesday June 04, 2014 @10:34AM (#7845736)
We are currently in the midst of a singularity of tools.

Stone > Bronze > Steel > Silicon > Software >

It's the "geek rapture" version that's more fantastic and extremely unlikely.

Re:"We need a pony. And the moon on a stick. By next Thursday." by _archon_ on Thursday June 05, 2014 @10:50AM (#7852223)
This is a very interesting perspective. What do you think is the next step? I am asking for an educated guess, or even interested speculation; people in the middle of the bronze age likely didn't know that steel was the next step until after iron was extracted for the first time.

If I had to guess, I would put the next phase at "integration" or "control." In that once we have functional, reliable libraries and virtual instruments, the logical next step is to integrate the high-level control of such into our physiologies. Alternatively, I could see "space" being an age we expand into, drawing our resources increasingly from space and broadening the scope of our potential that way. I'd like to see these happen in parallel if possible.

Re:"We need a pony. And the moon on a stick. By next Thursday." by jp555 on Wednesday June 18, 2014 @09:38AM (#7909969)
I'd say integration and control are N+1 optimization, not 0+1 invention.

Things like new forms of quantum logic/algorithms, artificial atoms, metamaterials, even subvocal tools (moving us from graphical user interfaces towards thought-based user interfaces), are more 0+1 to me.

Re:"We need a pony. And the moon on a stick. By next Thursday." by ThomPete on Wednesday June 04, 2014 @11:18AM (#7846040)
There is nothing wrong with studying and preparing for emergent complexity in distributed autonomous networks.

Not studying that would be cargo culture.

Re:"We need a pony. And the moon on a stick. By next Thursday." by dragonwriter on Wednesday June 04, 2014 @12:40PM (#7846595)
> It really surprises me that we think there's a realistic path to the singularity and that we obsessed about it. Human-like AI is a dead field

Even if the latter is true, its largely irrelevant to the former. Human-like AI might be one route to a singularity, but not required for it; most of the singularity predictions that I've seen are more centered more around humans rapidly (and at an ever-accelerating pace) becoming proportionately less of the "processing power" involved in the systems where they are the central intelligence, rather than human-like AI per se.

Re:"We need a pony. And the moon on a stick. By next Thursday." by moe on Thursday June 05, 2014 @01:23PM (#7852993)
I think you're attacking a very narrow strawman by making it sound like a singularity event is something we'd actively plan or work for.

Why do you think "human-like" AI is a requirement for a singularity to occur?

Isn't it much more likely to emerge simply as a side-effect from continued exponential technological progress and the ever increasing network density?

Maybe try to look at it with less anthropocentrism, perhaps consider how we have evolved from shouting to the internet in a mere few thousand years?

Do you think we'll still be using our eyes and hands to interface with the network, in another thousand years from now?

Re:"We need a pony. And the moon on a stick. By next Thursday." by VMG on Wednesday June 04, 2014 @11:20AM (#7846049)
I think future intelligent beings will be perplexed that so few humans were absolutely obsessed with the singularity, and artificial intelligence.

But only those beings who have the capacity of experiencing surprise.

See, I can make up predictions too.

Re:"We need a pony. And the moon on a stick. By next Thursday." by halfcat on Thursday June 05, 2014 @07:37AM (#7851348)
Human-level AI is not such a worthy goal. In a few years when self-driving cars are more common, we will be thankful that they aren't using human-like AI, otherwise they will get in wrecks for all kinds of preventable reasons. The human mind is highly irrational, though the general public scoffs at that statement. We are very dependent on our chemical state.
Re:"We need a pony. And the moon on a stick. By next Thursday." by davidgerard on Thursday June 05, 2014 @07:24AM (#7851310)
In the future, Roko's Femilisk will simulate you from first principles to see if you thought anything nasty about Tumblr social justice. http://newstechnica.com/2014/05/24/future-advanced-cyborg-hu...
Re:"We need a pony. And the moon on a stick. By next Thursday." by transpy on Wednesday June 04, 2014 @11:04AM (#7845932)
But... but... the exponential growth!
Re:"We need a pony. And the moon on a stick. By next Thursday." by entelechy0 on Wednesday June 04, 2014 @01:46PM (#7847025)
You are all fools! THIS IS THE SINGULARITY. WE ARE INSIDE OF IT RIGHT NOW!!!