News for hackers. Stuff that matters.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by knowtheory on Friday August 20, 2010 @10:36AM (#1620476)
Amusingly i think that Kurzweil demonstrates his ignorance all the more clearly in this post.

The brain is a product of not just the genome but the environment in which it develops. You are not just the product of your genome. You are the product of your genome and the womb in which you were incubated, and the environmental stressors on your mother.

You can't go from genome => organism without a WHOOOOOLE lot of Ceteris Paribus to fill in the gaps. Information theory is really pretty irrelevant to the subject of developing a biological model of the brain.

To clarify (having read Kurzweil's post more carefully), a lot of the interesting features of the brain are specified in the configuration and connections of the brain. The base building blocks and types of neurons might be specified in the genome (i'm not positive about that, i'm not a geneticist), but even if that were to be the case, Kurzwiel would have to demonstrate that environmental factors were not critical in the development of the structures of the brain that make us thinking beings.

I don't think he can do that. Biologists and computer scientists have spent a long time doing research on the building blocks of neural networks, and not only do the fields still face some difficult and fundamental challenges, but for the time being, it's very clear that we do not have the tools necessary to interrogate the brain in the manner we would need in order to be able to map interesting things out.

Perhaps things have changed in the 5 years since i graduated university, but... i haven't heard anything earth shattering that would indicate we do have the level of sophistication to computationally model the brain in an accurate manner, or even promising starts to such an endeavor.

Additional Edit:

Kurzweils assertion that we can't predict how technology will change is correct. Neither can he. Progress is a discontinuous non-linear process. It may be that we'll be able to track all the particles in the brain and watch them as the develop over time, but... then again it very well be that we won't be able to. Tinkering with brains in invasive ways is difficult, let alone non-invasive ways.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by illumin8 on Friday August 20, 2010 @10:42AM (#1620493)
You're mis-characterizing his post:

"It is true that the brain gains a great deal of information by interacting with its environment – it is an adaptive learning system."

Where does he say that the brain is only the product of its genome?

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by scott_s on Friday August 20, 2010 @10:56AM (#1620537)
That exact line illustrates that he does not understand Meyers' objections. He thinks Meyers meant that we need to also model all of the information that the brain gains as it interacts with its environment. That is not what Meyers meant.

What he meant is that we need to model everything that happens to the brain before it becomes a brain. That is, how the proteins interact with each other in the physical world to form the brain. Meyers' analogy was that the genome is the data, and the physical laws of the universe are the program. People are modeling how proteins fold and interact in the physical world, but it's a hard problem, and we're far from being able to do it for an entire organ.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by ewjordan on Friday August 20, 2010 @01:08PM (#1620925)
That is not what Meyers meant.

[We meander midstream into a heated discussion between Kurzweil and PZ Myers...]

Kurzweil: ...able to live...FOREVER!

Kurzweil: ...

Kurzweil: ...?

Myers: FFS, Kurzweil, you dimwit, we're the only two people in the room, and you can't possibly think you're going to get your standing ovation from me...

Kurzweil: Enhh...whoops, I guess my muscle memory kicked in, I've given that speech an awful lot of times, sorry about that...back to my main point, I guess: The Kolmogorov complexity of any "intelligence algorithm" is, with high probability, bounded from above by the size of the DNA string that picked that algorithm out of the entire universe of algorithms.

Myers: Kurzweil, you fucking idiot, if we want to build a brain, we need a lot more than just the bits of information in the DNA. There's an entire developmental pathway leading from DNA to its ultimate expression in a human brain, and you can't just pretend that we could write a simple algorithm to collapse that into one step.

Kurzweil: But I'm not saying that we want to build a brain by translating the DNA. I'm saying that the amount of information necessary to pick the brain's particular neural algorithm out of a full lineup of all possible neural algorithms (most of which would do nothing useful at all) must be coming from the DNA. Since the universe of all possible neural algorithms that can be expressed by DNA is highly unlikely to be have a disproportionate representation of useful neural algorithms, it's a matter of simple probability to see that the amount of information necessary to pick out a useful neural algorithm in any sufficiently large and random universe of neural algorithms is likely to be the same as the amount of information necessary to make that selection out of the DNA-expressible neural algorithms.

Myers: But you can't just translate from DNA to a brain, GODDAMN it, this is basic biology we're talking about! There's a lot of stuff that happens between DNA and a brain, and you can't just ignore it!

Kurzweil: Who said we were talking about biology?

Myers: I'M A F$@KING BIOLOGIST, OF COURSE WE'RE TALKING ABOUT BIOLOGY!!!

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jacquesm on Friday August 20, 2010 @02:53PM (#1621226)
You owe me a new keyboard.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by ynniv on Friday August 20, 2010 @12:17PM (#1620785)
Lets separate "modeling the brain" into two classes of work: modeling the interaction of complex proteins in large systems, and modeling the physiochemical structure of the brain. The first is very difficult, and we have been working on it for a some time already. Meyers' argument is that this is an astoundingly intensive job that will take an prohibitive amount of time. The later relies on both the former, and an understanding of how the most complex biological structure that we are aware of is constructed. Kurzweil suggests a (surprisingly low) bound on the complexity of this structure (which builds on complex proteins and should be seen as multiplicative of the former complexity).

But to say that Kurzweil is an optimist is to completely miss his perpetual argument. As drug companies dump billions USD annually into both complex protein research and sequencing technologies, we advance the state of the art in both of these classes. And while we have a long way to go, automation will get us there faster every year. If Meyers were to show that Kurzweil's estimation of complexity was off by 1000-fold, Kurzweil would still win because we would reach the goal 12 years later than expected, and "off by 12 years" isn't as wrong as "never".

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by sprout on Friday August 20, 2010 @02:04PM (#1621093)
>Kurzweil suggests a (surprisingly low) bound on the complexity of this structure (which builds on complex proteins and should be seen as multiplicative of the former complexity).

I think this is where most everyone really is missing the power of exponential growth, to use Kurzweil's language.

The difference between "surprisingly low" and spot-on is +-5 years in Moore's law time. Really what it boils down to is how long Moore's law continues.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by ynniv on Friday August 20, 2010 @02:31PM (#1621163)
A (the?) key point of Kurzweil's work is to show that the exponential growth of technological leverage is independent of Moore's law. His prediction is that when Moore's law runs out (being tied to transistor density, it must), something else of the same shape will replace it. That is obviously yet to be proven, but there are some nice historical graphs at http://en.wikipedia.org/wiki/Accelerating_change.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by ugh on Friday August 20, 2010 @11:30AM (#1620648)
Just for context, PZ Myers is a evolutionary developmental (“evo-devo”) biology researcher, which explains the thrust of his criticism. That kind of stuff (developmental processes in embryos, i.e. how the darn animal is built) is right up his alley.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by joecode on Friday August 20, 2010 @12:25PM (#1620806)
we need to model everything that happens to the brain before it becomes a brain

Perhaps the disconnect here is that Kurzweil, operating from an information theory perspective, is neglecting the possibility that the biological environment in which a brain grows effectively adds a ton of "data" to the system. That is, it's not as if brains can spring fully formed from the genome itself, and a few basic rules--it requires a very complex environment. So we're probably talking far, far more than 50MB of "data" here.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by ewjordan on Friday August 20, 2010 @01:52PM (#1621053)
Perhaps the disconnect here is that Kurzweil, operating from an information theory perspective, is neglecting the possibility that the biological environment in which a brain grows effectively adds a ton of "data" to the system

Please realize, despite the fact that pretty much everyone on HN is repeating this argument (the "data gets added to the system" argument), it is an extraordinary claim, and should require correspondingly extraordinary evidence if we're to consider it.

I'm going to justify this in excruciating detail, because the claim has now come up so many times.

But first, let's nail down the context, because if we can't agree on that then we really shouldn't even be discussing the topic (and I suspect the whole problem here is that Myers thinks they're arguing about something other than what Kurzweil is actually claiming) - we're discussing the amount of information that we would need to construct an effective intelligent algorithm. Not one particular algorithm, but any effective intelligent algorithm.

Here goes, a pseudo-mathematical breakdown of why this "data gets added" argument is so hideously wrong:

There's an entire infinite universe of "possible intelligence algorithms" (for the moment, we won't define this too precisely, but we'll hand wave and say that this universe consists of all algorithms that take the right inputs and provide the right outputs, whatever those are), most of which are utterly useless, and are certainly not intelligent. Let's call this universe U0.

Step one: let's cut U0 down to a finite practical size, eliminating ridiculous algorithms that we could never expect to implement. We can do this in a million ways, it doesn't really matter; for now, let's just say that we're cutting it down to algorithms that have possible physical realizations using the resources on our planet. That's still a huge number of algorithms. Call this U1.

Step two: Let's now trim U0 in a different way, picking out only the algorithms that we consider actually intelligent, however you want to define "intelligent". Name this (still infinite) set Z.

Step three: Take the intersection of Z (intelligent algorithms) with U1 (practical algorithms), call this set P. P is all the practical algorithms that qualify as "intelligent".

Now let Prob(I) = (size of P / size of U1), the probability that a randomly selected practical algorithm will be intelligent. This is an extremely small probability, but it's finite and non-zero (human intelligence suffices to prove that it's non-zero).

Step four: Now we slice up U1 in a different way, and create a set D_N: the set of all algorithms that can be specified by growing a human from a string of DNA of length N (and that ultimately run within the space constraints).

Step five: Set P(D_N) = intersection of D_N and P, all intelligent algorithms satisfying the space constraints that can be grown from a DNA string of length N.

Ok, that's a lot of sets, but it's okay, we don't need most of them. One last calculation:

Prob(D_N) = (size of P(D_N) / size of D_N), the probability that a randomly selected practical DNA-created algorithm will be intelligent.

No more set-fu, I promise. We've boiled it down to two probabilities, Prob(I), and Prob(D_N). These probabilities are proxies for the information content needed to pick an intelligent algorithm out of the corresponding sets of algorithms.

The "information gets added" claim has a very simple mathematical expression:

Prob(D_N) > Prob(I) when N = the length of human DNA

i.e. a randomly selected DNA-created algorithm with DNA length N has a greater probability of qualifying as intelligent than a randomly selected algorithm in general. And not just a little bit greater - you're saying that the fact that it's implemented via DNA makes the probability much higher, corresponding to the data difference you're claiming with the statement 'far, far more than 50MB of "data" here'.

Perhaps now you see the trouble: in order for me to consider the "data gets added" argument plausible, I need to hear an argument that suggests that a random construction based on DNA is far more likely to lead to an intelligent algorithm than a random construction in general.

Myers has not offered an argument in this direction. Neither has anyone else. Until someone does, the odds are overwhelmingly in Kurzweil's favor; statistically speaking, Myers is flat out wrong.

So I put the question to everyone: what's so special about the DNA construction process that makes it so much more likely to create intelligence than any other construction process we might conceive of?

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by 10ren on Friday August 20, 2010 @03:53PM (#1621384)
I think there's an argument that DNA is more likely to lead to life (not intelligence) than an arbitrary coding scheme; that is, that with DNA it's easier to create life than you'd expect for a vanilla encoding scheme.

This assumes that during the billions of years on earth before DNA, lots of different chemicals came together, but if any self-replicating one came together, it would grow and still be around. Exceptions are if it wasn't very good at it and died out, or that DNA-based life attacked it or grew faster, crowding it and starving it (or bad luck wiped it out - but it could arise again.)

The fact that DNA did survive shows that DNA is indeed specially suited to encoding life. One might even try to estimate how specialized it is, by estimating how improbably it is, based on how long it took for a planet of experiments to arrive at it.

The details of how it's special could be in terms of protein folding, eg. that you can specify some really cool and useful folds, crucial for life, in surprisingly short DNA sequences. It's as if the search space of encoding schemes was scoured for schemes that in effect included a handy collection of library functions.

But this lovely (I think) argument doesn't apply to intelligence at all; nor even to mammals, or indeed animals - just for basic life. Once life existed, all the extra features were just hacked on.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by joecode on Friday August 20, 2010 @02:37PM (#1621178)
But first, let's nail down the context, because if we can't agree on that then we really shouldn't even be discussing the topic (and I suspect the whole problem here is that Myers thinks they're arguing about something other than what Kurzweil is actually claiming) - we're discussing the amount of information that we would need to construct an effective intelligent algorithm.

If that's the question, then sure, I agree with you. In fact, I imagine something intelligent code be encoded with much less data.

My point was about the information content required for the human brain itself, and that seems to be what Kurzweil is talking about, at least:

The amount of information in the genome (after lossless compression, which is feasible because of the massive redundancy in the genome) is about 50 million bytes (down from 800 million bytes in the uncompressed genome). It is true that the information in the genome goes through a complex route to create a brain, but the information in the genome constrains the amount of information in the brain prior to the brain’s interaction with its environment.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by ewjordan on Friday August 20, 2010 @04:23PM (#1621500)
You're absolutely right - looking at that quote (and looking through the original one that Myers responded to), he's overstated what we can conclude based on DNA length by a good amount (though Myers argument doesn't disprove the upper bound, by any means; it merely points out that Kurzweil's "proof" doesn't hold). The problematic phrase, which makes this argument pretty ambiguous, is "simulate the brain" - neither party has really pinned down what they mean by that, so it's hard to know what would qualify. In retrospect, I think I cut Kurzweil a little too much slack when deciding what he meant, esp. in light of his other writings on the topic...

It's a shame, because his argument is fully defensible if it's stated correctly and applied to the general problem of AI instead of to Kurzweil's pet theory that full brain simulation is the One True Way.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by ars on Friday August 20, 2010 @02:28PM (#1621150)
Protein folding.

The amount of computation, and program expressibility involved in folding a protein is far far far more than you would expect from just counting the DNA that made that protein.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by ewjordan on Friday August 20, 2010 @02:59PM (#1621234)
Yes, "fold proteins" is a member of a distinguished class of algorithms that DNA is exceptionally well suited to handle.

Similarly, "simulate shallow wave dynamics" is in the class of algorithms that a water tank is pretty near optimal for, and the "find local minima" problem is handled with remarkable ease by gravity and a rolling ball; we'd be hard pressed to write computer programs that solve any of these problems using fewer bits than we can get by with by using the real world to solve them instead.

But most algorithms are not made that easy by any of these computational substrates; in fact, vanishingly few of them are, and an algorithm is only likely to be "easy" relative to vanishingly few systems.

What would let us assume that "Do intelligence" is a member of the subset of problems that are made easy by the detailed workings of biology? Because the a priori probability that it falls into that class is just about zero...

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by kragen on Friday August 20, 2010 @03:05PM (#1621251)
From "counting the DNA", you would expect that the family of hundred-amino-acid-long peptides, which are encoded in strings of 300 bases, would have 4³⁰⁰ = 2⁶⁰⁰ possible three-dimensional conformations, or rather probability distributions over conformations, since many peptides have multiple stable conformations.

However, those 2⁶⁰⁰ sequences of bases are immediately reduced to 20¹⁰⁰ ≈ 2⁴³² possible sequences of amino acids (ignoring the start and stop codons, which are presumed to lie just before and just after the 300-base sequence in question).

Are you suggesting that these 2⁴³² different peptides somehow express many more than the 2⁶⁰⁰ different three-dimensional structures, or rather, probability distributions over them? Because that seems like a highly implausible claim, on the face of it.

Or are you going to answer, "Fucking arithmetic. How does it work?"

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by Retric on Friday August 20, 2010 @01:20PM (#1620964)
Chemistry is a "solved problem" granted we don't have a computer that can run the simulation for large organic molecules, but it has ZERO secrets. Now, DNA runs on the cellular machinery, but that is also running on the well known chemistry rules so adding up the instructions required to define a cell + DNA = something of a lower bound on the required complexity to create a brain. The idea is if you know how complex a solution to the problem is, then you can use that complexity even if you are using a different approach to the problem.

IMO, it does not say much. I can't comprehend the limits of 50MB of heavily macroed and slightly buggy LISP code. It's simply not a meaningful metric. Edit: Also, in theory we could write a program which would simulate human level intelligence, but run far too slowly to be useful in any meaningful context.

PS: Findman had a wonderful description of chemistry as the search for rules of thumb to let people simplify the problem of simulating the physical equations.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by nkassis on Friday August 20, 2010 @11:58AM (#1620729)
Is that even required? I mean, to simulate a brain, would you really need to go all the way down to simulating every cell or could an averaging of the interactions be enough?

I don't know if what I said even makes sense but I really don't believe that we need something that simulates the brain at the cell level to replicate some of the processes.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by scott_s on Friday August 20, 2010 @12:19PM (#1620790)
We don't know, which I think is Meyers' point. That is, until we understand all of these interactions, we don't know what the brain actually is.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jasongullickson on Friday August 20, 2010 @11:55AM (#1620715)
Based on this post (and more so what I've been able to find of the original discussion) I don't think he's overlooking this at all; if anything it's so obvious that he's not calling it out literally, like saying "I'm building an automobile"; you don't expect to have to say it's going to have wheels...
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by scott_s on Friday August 20, 2010 @12:23PM (#1620801)
That's because we already know how a car works. We know that wheels and an engine are necessary, but a cupholder is not. Meyers' point, as I understand it, is our understanding of the brain is not yet sophisticated to know what we can exclude from simulation.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by kragen on Friday August 20, 2010 @03:06PM (#1621253)
When Wilbur and Orville Wright went to go build a bird, they did not endow it with a beak and talons.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by dean on Friday August 20, 2010 @12:54PM (#1620886)
A lot of this discussion seems to be confusing reverse engineering with cloning. To reverse engineer something, you look at it as a black box and determine all of the capabilities and characteristics that you are interested in, and then you implement them in your own way.

You do not need to understand how every last cell of the brain was created in order to build a machine that works like the brain. To reverse engineer the flight of a bird, you don't clone the bird, you build an airplane.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by Jkeg on Friday August 20, 2010 @01:27PM (#1620992)
The human brain does not need to store all the information in the environment in the genome to develop fully, so why should an AI need to? I expect an AI would include that data in the development of it's brain just as a human does, by being put in an environment to learn from and absorb that data. In other words, design and development are different kinds of data here, and a human's and an AI's initial brain design can be stored in ~50MB of data.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jacquesm on Friday August 20, 2010 @10:46AM (#1620506)
You sidestep the whole embryology problem like that. The 50 megs of data we're talking about encodes the basic building blocks, the scaffolding, and some of the process, but not the end result. DNA encodes proteins, not brains.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by sprout on Friday August 20, 2010 @11:23AM (#1620629)
You sidestep the whole hardware problem like that. Computer code encodes software programs, not computers.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jacquesm on Friday August 20, 2010 @11:26AM (#1620636)
Correct, all this is premised on the fact that we think that we can simulate a brain by using nothing but software.

If that's not the case then we will most likely have to revise our view of biology drastically.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by raimondious on Friday August 20, 2010 @10:54AM (#1620532)
I thought that comment was still a little inaccurate — "the environment" in biology is not only what the brain actually processes and learns, it includes the chemical environment as well. The genome does not explicitly describe how the cells should develop, and this is different from how the brain changes in response to neural input.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by sprout on Friday August 20, 2010 @11:20AM (#1620618)
Presumably when we're talking about this task the first simulation would take place on a very large cluster, with a lot of human data as input.

Kurzweil is giving a lines-of-code metric, but lines-of-code is only one piece of the puzzle. Kurzweil is calling LOC analogous to DNA. Chemistry is analogous to the actual hardware (of which there will undoubtedly be a lot) and classical 'experience' is just that. I'm beginning to feel like the people who understand the biology are misunderstanding the computer science.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by raimondious on Friday August 20, 2010 @12:34PM (#1620837)
I think the debate is this: The CS people see the biologists as overcomplicating the problem while the biologists see the CS people as oversimplifying.

I do understand that eventually we will be able to simulate the brain of an adult without having to simulate all the development that created that adult brain and all the minute chemical mechanisms that enable fat and protein to think. You can simulate important parts of the basic components and get the same output as a real brain doing the same thing.

However, I think that since many computer scientists see the brain as a chemical computer, they misunderstand how close we are to knowing how it actually works. We have conceptual holes in our understanding in how the brain actually processes input. We are not at the point where we can start simplifying: if we want to truly simulate what we know about the brain, we have to include the activity of every molecule, since we don't yet know what activity we can ignore.

We want a Newtonian physics simulator, but we only know subatomic interactions — we have to simulate the entire universe even though F=ma is underlying it all. [Edit: yeah we understand a lot more than that but I think the analogy still applies.]

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by sprout on Friday August 20, 2010 @01:58PM (#1621075)
The big thing I think Kurzweil is absolutely right on is that if Moore's law continues (even in its current crippled parallel-only form) until 2045, we can't help but have the ability to simulate a human brain. Am I convinced that will happen? No. But no one has made any money betting against Moore's law since decades before I was born. It's a fact of my life until proven otherwise.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by senki on Friday August 20, 2010 @11:01AM (#1620556)
Here: "the brain prior to learning and adaptation". Unfortunately there's no such thing.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by knowtheory on Friday August 20, 2010 @10:51AM (#1620522)
Yeah, apologies, i've edited my post to clarify
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by gfodor on Friday August 20, 2010 @10:43AM (#1620498)
Here's something to think about. What does the bitwise encoding of the "brain related" part of the genome actually mean then? Say it's 50 megabytes. Does this mean nothing? Why is it 50 and not 500 nor 5? Surely there's meaning in the amount of bits necessary to encode the genomic information to create a brain. Kurzweil is simply throwing this figure out as food for thought, that from an information perspective this is the kernel of knowledge necessary (with sufficient simulation of the environment) to "grow" a brain.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by cma on Friday August 20, 2010 @11:18AM (#1620608)
"this is the kernel of knowledge necessary (with sufficient simulation of the environment) to "grow" a brain."

Wouldn't it be simpler to say "put 10^80 hydrogen atoms really close to each other and wait a few billion years". Simpler, and just as useless (insofar as it doesn't get anyone closer to simulating a brain in the next 10 years).

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by kragen on Friday August 20, 2010 @03:13PM (#1621273)
Well, there's no guarantee that doing that will generate brains. It might turn out that the vast majority of such simulated universes would fail to contain intelligence.

The human genome, on the other hand, succeeds in growing intelligent brains a more or less measurable fraction of the time, in only a couple of years: at least 5%, if we assume that 94.9% or so of all zygotes fail to implant or otherwise miscarry, and another 0.1% suffer some kind of disability that forecloses the development of intelligence.

This is observably different from the development of most similar-sized chunks of matter, even biological tissue, over similar timescales. For example, my body has contained about 100kg of biological tissue for the past 15 years. That's enough time for each 10kg chunk of it to develop intelligence about 7 times. But I'm not aware of any new intelligent entities in my body during that time. Some might doubt the existence of any intelligent entities in my body at all.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by shithead on Friday August 20, 2010 @05:03PM (#1621620)
> I'm not aware

Well, no, of curse you wouldn't be. Insensitive clod.

(Signed, The bacteria in your bowels. P.S. stop it with the random antibiotics, or we'll give you a good run).

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by Unseelie on Friday August 20, 2010 @11:36AM (#1620660)
At our universe's speeds, but how fast can you simulate it?
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jacquesm on Friday August 20, 2010 @10:45AM (#1620504)
Think of it as the input to a fractal generator that will expand that input seed in to a physical structure many orders of magnitudes larger than the seed.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jerf on Friday August 20, 2010 @12:26PM (#1620813)
For everybody else having trouble with the information theory aspect of this argument: Pop quiz, how many bits of information are contained in the Mandelbrot set? When you figure out the answer to that question, and really internalize the answer, you'll be in a much better position to understand Kurzweil's argument here.

(And forgive me if I think understanding it should be considered a prerequisite to refuting it. Most commenters here are skipping that step. He may yet be wrong, but surely we can at least do him the courtesy of engaging with his actual argument and not dim reflections from a funhouse mirror?)

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jacquesm on Friday August 20, 2010 @12:37PM (#1620845)
That was sort of the point, given that the mandelbrot set contains very little real information and that you can express the whole set in one line of math you can take a stab at thinking about the complexity of the structures that you can generate when your input is substantially larger than that.

Find the formula and you have a shot at computing the end result but we're very far away from being able to trace the path from DNA to deep brain structure. Right now we're stuck solidly on being able to figure out the structure of the proteins fast enough (Anton?), once that's more easily done we can move on to the next level of the problem, the interactions of large numbers of proteins in a soupy environment.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jerf on Friday August 20, 2010 @01:03PM (#1620914)
By "everybody else", I mean "everybody else not jacquesm", sorry. I am frustrated that you seemed to be the only other commenter understanding it. I was trying to amplify, not criticize. A lot of people are making arguments (without realizing it) that equally well prove we can never compute anything about the Mandelbrot set because look at the amazing staggering complexity it has, except that A: obviously we have and B: the information content is actually quite small.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jacquesm on Friday August 20, 2010 @01:21PM (#1620968)
I think that's rooted in the number of disciplines that cross in bio-informatics. Code, reverse-engineering, information theory, math, genetics, chemistry, physics and so on.

It's almost by definition interdisciplinary and I doubt there is any one person that really has the whole view.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by knowtheory on Friday August 20, 2010 @10:55AM (#1620535)
I mean, Kurzweil is making the same sort of statement that Stephen Wolfram made, claiming that the entire universe is probably one or two lines in mathematica.

Is that a meaningful statement? What does that actually imply?

If you look at the sort of neurological problems that humans exhibit, particularly due to developmental defects, the genome actually encodes a wide variety of possible brains. It may very well be that the human genome encodes for all sorts of general neurological matter. I think that we really are giving short shrift to the importance of brian development.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by kragen on Friday August 20, 2010 @03:18PM (#1621283)
Kurzweil has had noticeably more success simulating intelligent processes in software than Wolfram has had simulating the universe.

The majority of human beings who survive to birth eventually develop some form of intelligence, despite wide variation in their environments. Even children raised by wolves show substantial ability to learn, even though they rarely develop language. By contrast, treating a chimpanzee or a dog like a human child will not result in the development of fluent language or super-dog intelligence.

This suggests strongly that much of what we call "intelligence" is encoded in our genes, not acquired from our environment.

Additionally, though, if we could develop a robot that could acquire culture as easily as a human baby (or even five times more slowly), we could raise it as a human baby and claim success.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by Unseelie on Friday August 20, 2010 @11:34AM (#1620657)
People keep saying this about any project to build a synthetic brain, and it has a huge level of merit...but its putting the buggy before the horse. You have to be able to build a brain before differences in its experience start to matter, and you have to be able to build the software before the hardware matters. There'd be no point in building experience sets before you built the brain, much as there's little point discussing their importance on a brain as a reason for being unable to build one.

So what if all we can put together is a feral child? It still implies we've built a brain.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by knowtheory on Friday August 20, 2010 @12:26PM (#1620809)
I don't agree.

I think you underestimate the degree of development and learning that takes place in the womb (language starts developing for instance). Feral children were still incubated by a mother.

If you were to mash together a bunch of neurons, you won't get a brain. You'll get a mess of neurons and random firing. That's the thing, that development of the brain and the arrangement of and connections between neurons is the critical component. They're dictated by genome, yes, but also by biological environmental factors (hormones), but also by external environmental factors (auditory through the womb).

Maybe you can grow a bunch of neural structures that look like a human brain, but it's just as likely that you'll only get an undifferentiated mass that's as smooth and intelligent as a bowling ball.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jacquesm on Friday August 20, 2010 @03:13PM (#1621275)
A big part of the problem here is that people tend to think of us humans with our intelligence as something with purpose.

But if you looked at it in a different way, think about us as a collection of cells that all happen to have roughly the right environment to survive in, hooked up in roughly the right way to their neighbours. a series of inter-dependent colonies forming a symbiotic ecology then the picture changes dramatically.

It suggests that it is possible that intelligence is emergent if you have something that is roughly that structure, create something that is organized along the lines of a human brain with computational elements in it that can connect in the same way our nerve cells do and such a colony would have the potential to develop intelligence.

If you phrase it like that I think you get the closest to Kurzweils argument without any roundabout through the messy workings of biology.

What Meyers suggests is that the biological part is a requirement. I'm not qualified either way, but I think it is very well possible that they both have a valid point, and that the end solution will contain a portion of both.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jon_hendry on Friday August 20, 2010 @03:11PM (#1621267)
Also, you're born with a lot of neurons that are then pruned off during childhood. Newborns have more neurons than adults. Adults have more glial cells.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by jimbokun on Friday August 20, 2010 @12:02PM (#1620737)
"(with sufficient simulation of the environment)"

The point is this parenthetical dwarfs the information in the genome to the point of irrelevance.

At least, that is Myer's argument, as I understood it.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by TheEzEzz on Friday August 20, 2010 @12:46PM (#1620866)
>You can't go from genome => organism without a WHOOOOOLE lot of Ceteris Paribus to fill in the gaps.

Of course not. Likewise, if all you had was the binary of a Linux distro, and you didn't have a computer or any other associated hardware, it would be very hard to get that code running.

On the other hand, if you were trying to recode the distribution from scratch, without trying to decompile anything, a good ball park estimate for the size of your source code would be the size of the original distribution.

That's Kurzweil's point: he's simply trying to measure the complexity of the system, to get a rough estimate for how complex the model will need to be.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by clevercode on Friday August 20, 2010 @01:07PM (#1620922)
Recreating the source code by itself does not, in this case, constitute a "model". In order to actually run that binary, you also need to create a virtual computer for it to inhabit.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by kemiller on Friday August 20, 2010 @01:17PM (#1620957)
The genome is the source code for that, too.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by clevercode on Friday August 20, 2010 @01:55PM (#1621062)
True, but that fact only becomes useful after you already have it running on a virtual machine. Chicken-and-egg problem.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by kragen on Friday August 20, 2010 @03:27PM (#1621311)
The chicken-and-egg problem can take a certain amount of effort to solve, but it's not a major engineering obstacle.

The easiest way to bootstrap a self-compiling compiler from bare metal is probably by writing a Forth inner interpreter in machine code, which is a few hundred bytes; a Forth outer interpreter in threaded code, which is a few hundred cells; and then an interpreter for the language of your compiler in Forth, which is likely to be a few dozen to a few thousand lines of code, depending on the language. (I don't know if Forth is good for anything else, but it's optimal for this.)

I don't know how to estimate this task properly, but I doubt it's more than a few weeks of work for a skilled person.

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by kemiller on Friday August 20, 2010 @06:02PM (#1621761)
But the claim wasn't that having the genome is directly useful, rather that it's a decent approximation of the upper bound on the irreducible complexity.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by kragen on Friday August 20, 2010 @03:22PM (#1621300)
You could probably recode the Linux distribution in 10% of its current size just from knowing where you were going and having an arbitrary amount of time to finish the job, or 1% or less if you didn't have to interoperate with any hardware or software already in the wild. It's full of Greenspunning and other forms of code duplication.
Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by anamax on Friday August 20, 2010 @11:53AM (#1620710)
> The brain is a product of not just the genome but the environment in which it develops. You are not just the product of your genome. You are the product of your genome and the womb in which you were incubated, and the environmental stressors on your mother.

While I may be a product of my genome plus a specific womb with specific stressors (which affected that womb), we're not trying to duplicate me.

It's sufficient to generate a brain from a genome and some womb, aka "development environment".

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by esrtgadg on Friday August 20, 2010 @10:55AM (#1620536)
Decider: Behaviours and abilities of feral children. Winner: Myers.

Next? ;)

Re:Ray Kurzweil Responds to "Ray Kurzweil does not understan... by Tichy on Friday August 20, 2010 @12:37PM (#1620844)
Well how much information is encoded in the brain making process? Isn't most of it the same that is used for manufacturing all other living tissue?

Either way, I don't see you or any other naysayers giving any numbers. Just a vague "it's all too complex we'll never get it". Maybe, maybe not - but it is just a claim, which hardly seems enough to justify trashing Kurzweil.