How does a difference in the level of intelligence of a particular entity compare to the effective intelligence of having lots of less intelligent entities? Having lots of people means that you can apply intelligence towards a lot of tasks, but perhaps all of them together will never come up with something that a greater intelligence could come up with.
Thinking about it, it seems to me that you have to apply it against an actual difficult task. Take a task like "build a power-producing fusion reactor" that nobody knows how to do yet. Would we be able to figure out how to do that faster if there was some superior intelligence applied to it? Or does the huge number of engineering problems associated with building such a thing respond better to a large number of more ordinary intelligence?
Sorry for reviving old thread.
edit: And the collective is significantly more intelligent than the individual (for some but definitely not all reasonable definitions of intelligent and collective).
Only in the sense that Stalin or Pinochet was a productive citizen. Powerful people can mobilize others to their own ends without those ends being at all good or moral for everyone who is not so mobilized.
From agrarians to victors of ww2 in ~20 years is pretty impressive by any measure.
> Human-level AI will likely be practical this century.
Both are unknown.
Well we exist, so we know human-level intelligence can be implemented in physics. So we certainly know AI is possible.
In fact, I think it is quite clear that we are capable of designing systems that are more intelligent than an unaided human (or even group of humans). One of the first such systems were writing. I also tentatively claim that new means of recording and arranging knowledge (which we do today by means of computers) is another step towards superhuman intellect in the strictest sense of "more than mere human".
I think it is an open question what will come out of our playing with genes directly. I certainly expect we'll able to produce some change in the human condition, I hope some of that change will be for the "objectively" better. I have no idea if it will directly impact our intelligence.
"Designing" isn't necessary for creating (OTOH, whether we can artificial select for it and avoid selecting for dead ends may be an issue.)
Btw, Crystal Nights by Greg Egan is a fascinating short story: http://ttapress.com/553/crystal-nights-by-greg-egan/
We have no mean to know. Maybe the subjective experience is an inherent part of our intelligence, and not just a side effect. And I do not see any way of applying the scientific method to the subjective experience.
Nethertheless, I really hope that the future will prove me wrong.
Further, beyond the task of software improvement, the task of improving hardware is itself already heavily software-mediated when performed by humans, and will likely be a prime candidate for applying pre-AGI AI.
There are likely other ways to attack the problem, such as not focusing on hardware improvements per-se, but instead on the cycle time for getting the improvements deployed (eg. somehow eliminating or cutting the size/cost/construction time of new Fabs).
Given how far away from that goal we are now, after 85 previous years of research, I would not hold my breath for reaching that goal in the next 85 years.
There are two things holding back AI (which from a singularity-standpoint just means "a machine capable of general problem-solving", and not "a machine possessing the ineffable characteristics of human consciousness"). First, we don't know how. Second, we might not have the computational capacity.
While we still don't know how, the bar is getting lower and lower as time goes on. Increasing computational capacity means that we can start with worse and worse initial versions of a general intelligence. Maybe a really special genius could write a general problem solver which ran on a 386 (even if it lacked the self awareness to feel the pain of running on a 386). Maybe we're too dumb to ever write a general problem solver even if we had an infinately fast computer with unlimited memory.
But even if programmers have made no progress since the 1960s, we are definitely not in the same position.
That depends on who is saying it. I've noticed that when actual researchers say, "We hope this will provide a treatment for reticularly homicidal brain-worms within 5 years", they mean they have no idea if or when any such practical material benefits will appear. If they say, "We will be able to get effectively unlimited amounts of energy from russet potatos within 20 years," they mean they don't believe it's ever going to happen.
If the difficulty is exponential, as I rather expect it to be (in my own completely unfounded opinion), then lowering the bar a given amount doesn't help much. And as far as increasing computational capacity goes, we're already deep into the realm where communication costs outweigh actual computational costs, which makes it a whole different ball game going forward.
If you want a further speculation, I suspect that modern statistical methods like those behind th' Goog, self-driving cars, and what-not will not get too much closer to a super intelligence than conventional heuristic search. They're capable of doing a lot of things easily, that only humans could do heretofore, but they're not actually more powerful. So, "a machine capable of general problem-solving" is easily conceivable in the same sense that you are capable of general problem solving, but I can't see a singularity on the other side of that.
Now we know the real motivation behind pretty much every sci-fi storyline involving AI revolts.
So, having a look at wikipedia, we find: "Inspired by Babbage's difference engine plans, Per Georg Scheutz built several difference engines from 1855 onwards, one of which was sold to the British government in 1859." -- that's very convenient. We can cheat a little, and say that in 1929, there'd been about 86 years worth of research into computing -- and so by extension, achieving AI by 2100 is a greater feat than the NSAs new data center was as seen from 1929?
Perhaps. Makes for some interesting thought experiments.
Human-level AI is possible.
Human-level AI will likely be practical this century.
Once AI is sufficiently advanced, it will be capable of AI research.
Most terminal goals would lead to intelligence enhancement as a sub goal, as any system with a goal would be better able to pursue it if more intelligent. Therefore, most AIs will devote resources to increasing their intelligence.
Assuming humans are not near the maximum possible intellectual level, super-human AI will likely be developed soon after an AI is created that is as smart as the smartest human.
This means the future will not be controlled by humans, as we will no longer be the smartest things in town.
Unless we can predict the goals of the AI, we should consider the future unpredictable after the point of its creation, as our models of the future rely on human-shaped agents with human goals and capabilities. With these assumptions broken, we have a sort of singularity, a breakdown of our models of the future.
It's quite conjunctive, but this all seems pretty reasonable to me - and it's worth spending resources studying.