News for hackers. Stuff that matters.
Re:The Singularity is not coming by bermanoid on Friday August 10, 2012 @05:45AM (#4365564)
The author completely misses the point of these arguments.

This is not about science increasing the rate of scientific progress. It's about computation improving the rate of computational progress. Particularly, the "Singularity" is about that happening in a world where strong AI exists.

And I'm not even going to harp on the fact that the number of computations per second that we perform on this planet has been undoubtedly exponential at least for a while, because that's not the real point.

The real point is that like the author says, human creativity is still the driving force in computational advances, and human creativity can't be sped up by periodically doubling clock rates or core counts.

If it could? Those doublings would happen even quicker, and the exponential growth we've seen so far would be nothing.

This does, of course, require that you believe that strong AI is possible at all, and that the entire process of creativity could eventually be put into software. If you don't believe in that in the first place, then there's no point having the argument at all - you don't argue the details of a nuclear chain reaction with someone that doesn't believe in neutrons.

Re:The Singularity is not coming by rvkennedy on Friday August 10, 2012 @06:50AM (#4365666)
It's about computation improving the rate of computational progress

But computation doesn't improve the rate of computational progress. That's achieved by improvements in manufacturing. Computation does help a little, giving us better tools for chip design. But mainly it's manufacturing.

The only way for computational progress to exponentiate, past the limit of Moore's Law, is to use more physical resources - computers get literally bigger.

And so expensive that only the five richest crowned heads of Europe can afford them!

Re:The Singularity is not coming by jpadkins on Friday August 10, 2012 @10:26AM (#4366278)
are you stating that computer manufactures don't rely on computers to design the next generation manufacturing techniques? Or that faster/better software isn't going to increase the rate of improvement in computer manufacturing?

Material scientists , physicists, chemists, chip designers are all using software for modeling and exploration. And bigger/faster/better computers are helping drive innovations back into computer manufacturing. The process is feeding itself, and it has been for awhile.

Re:The Singularity is not coming by Anderkent on Friday August 10, 2012 @07:32AM (#4365742)
But computation doesn't improve the rate of computational progress.

As long as it's people developing computing devices, that holds. But when you have a machine that is capable of improving its own software, you get a self reinforcing loop where computation improves the rate of computational progress.

Re:The Singularity is not coming by loup-vaillant on Friday August 10, 2012 @08:55AM (#4365914)
Intelligence doesn't even have to feed on itself. Imagine a human-level hardware designing AI. As long as Moore's law applies, it can double its computational power every 18 subjective months. From our point of view, that's 18 months, then 9, then 4.5…

If Moore's law where unlimited, such an AI would have infinite computational power in 36 months, with absolutely no increase in actual intelligence. But of course Moore's law is limited. Still, we could expect quite a bit of progress from a mere AI hardware designer.

Re:The Singularity is not coming by TheComedian on Friday August 10, 2012 @09:14AM (#4365978)
This assertion is groundless. Why would Moore's law accelerate? In fact, Moore's law is currently decelerating and gains are increasingly harder to find. Further, Moore's law says nothing about computational speed, but only the density of transistors. These two are related but not identical.

Edit: also, from my understanding, the gains in transistor density largely depend on new discoveries in physics. Before a computer can aid in accelerating Moore's law it would need to be sufficiently advanced to generate new discoveries in physics, but at this point you'd have a computer smart enough that it Moore's law wouldn't matter much. Seems like putting the cart before the horse to me.

Re:The Singularity is not coming by loup-vaillant on Friday August 10, 2012 @09:51AM (#4366119)
Transistor count and computational are so tightly correlated that's nitpick.

Now I did not assume "Moore's law" would accelerate. I assumed it would stay constant. The key point comes from the fact the AI (or AI hive) would trivially benefit from hardware speed-ups.

And yes, Moore's law won't really count, compared to the rest we will be able to do. I was just trying to be as conservative as possible. (Though Moore's law still holding until strong AI is quite wild).

Re:The Singularity is not coming by joe_the_user on Friday August 10, 2012 @03:37PM (#4367841)
Further, if we build a human-like intelligence on a chip, this would plausibly be a highly parallel algorithm. By that token, you wouldn't need more transistors-per-inch, you could use chips that snap-together with high bandwidth connections and perhaps some longer-distance traffic control connections.

The kind of design isn't an NP-complete problem but it certainly could be helped by a powerful AI.

Also, Moore's Law is breaking for speed but not for transistors-per-inch. That's why we're seeing multicode chip now.

Re:The Singularity is not coming by wcarss on Friday August 10, 2012 @09:03AM (#4365939)
I do not believe that that is what Moore's Law means or how it works.

Perhaps I just mistook your meaning - what do 'subjective months' mean? Why do they mean that the doubling time starts halving?

Re:The Singularity is not coming by loup-vaillant on Friday August 10, 2012 @10:01AM (#4366178)
I mean this: http://dragonball.wikia.com/wiki/Hyperbolic_Time_Chamber

When hardware is twice as fast, the AI works twice as fast. In 9 months, it will do 18 months worth of work. Now keep the doubling up, and it will have done infinite work after 36 months.

Re:The Singularity is not coming by treelovinhippie on Friday August 10, 2012 @08:52AM (#4365904)
So designing the next generation of Intel chips using the latest Intel chips isn't "computation improving the rate of computational progress"?
Re:The Singularity is not coming by maxerickson on Friday August 10, 2012 @09:16AM (#4365985)
To increase "computational progress" on an exponential scale, the rate of improvement has to increase.

If the rate of improvement were constant, the progress would be linear.

In short, something is improving the rate (but it probably includes more designers and better methods, not just more complexity management).

Re:The Singularity is not coming by smoyer on Friday August 10, 2012 @09:09AM (#4365956)
Actually he misses a second point too ... the reason you don't see exponential growth in human-led research is that we each start out with "empty" brains. To become truly knowledgeable in a field may require a life-time.

I'm not arguing that the singularity is near either, but machines would have the advantage of creating offspring that are already as knowledgeable/intelligent as themselves. Something I couldn't do for my children.

Re:The Singularity is not coming by fchollet on Friday August 10, 2012 @05:59AM (#4365592)
How is throwing more (truly intelligent) computers at the problem any different than throwing more human brains at it? It's not just computing power that had been exploding, it is also the number of people trying to crack the nut of AI (for instance).
Re:The Singularity is not coming by gd1 on Friday August 10, 2012 @07:23AM (#4365726)
Because the human brains can only communicate and acquire knowledge at a limited rate. This causes the "exponential decrease of discovery impact of each succeeding researcher" that the original post refers to, but he misses the point completely. We can't 'stand on the shoulders of giants' until we've climbed up there, slowly and painfully. An AI can just download the lot. And share any new discoveries with the hive mind.
Re:The Singularity is not coming by jpadkins on Friday August 10, 2012 @10:37AM (#4366329)
it's sci fi, but we haven't ruled out that human brains can't acquire knowledge at rates orders of magnitudes faster than current learning methods. Big advances in neuroscience and linguistics could make this possible.

Right now, the limits on our bandwidth is language and our sensory inputs. It's not completely ridiculous to think we could encode certain kinds of knowledge in more compact forms, and transmit them via an artificial sensory process that has higher higher bandwidth that audio/visual language based learning...

Re:The Singularity is not coming by FeepingCreature on Monday August 13, 2012 @01:39PM (#4377019)
The singularity idea does not care how the self-improvement feedback occurs.