Re:How tiny wasps cope with being smaller than amoebas
by cs702 on Friday July 06, 2012 @01:10PM
(#4208637)
Wow: with only 7,400 neurons (compared to 340,000 for the common housefly and 850,000 for honeybees), this wasp can somehow fly, search for food, find the right places to lay its eggs, etc.
That ridiculously tiny neural network is one freakingly efficient computing device!
Re:How tiny wasps cope with being smaller than amoebas
by Xcelerate on Friday July 06, 2012 @01:27PM
(#4208756)
7,400 seems very capable of being simulated. In fact, that's a small enough number that I'll bet you could map those connections out by hand with some type of microscope.
To someone more knowledgeable in this subset of biology, is this possible?
Re:How tiny wasps cope with being smaller than amoebas
by agravier on Friday July 06, 2012 @02:43PM
(#4209083)
It is possible, but the neurons are actually complex computing units that take a plethora of signals into account: subtle temporal behavior (relative timings of post and pre-synaptic activations), complex chemistry in the cell as well as the in the synaptic cleft, and many more less understood things.
Secondly, as you can imagine, the connectivity is far from random. Like in larger nervous systems (or even more than in large pools or neurons), these computing units take precise roles, part due to the developmental process, part due to later stage learning. But in the end, the machinery is precise, and simulating it requires understanding all of it.
I believe that this understanding should not come though imagery alone, but also through studies of the development of these organisms' brains. Like we are now forming artificial neural maps through "machine" learning techniques that are accelerated versions of their biological counterparts, I believe that we should develop developmental algorithms into large-scale simulations. The goals being to first understand how it works, second to see if the models are able to replicate the end result, a good indication that they are useful models.
Re:How tiny wasps cope with being smaller than amoebas
by giardini on Saturday July 07, 2012 @01:26AM
(#4210811)
Jefe: "It is possible, but the neurons are actually complex computing units that take a plethora of signals into account: subtle temporal behavior, complex chemistry in the cell as well as in the synaptic cleft, and many more less understood things. Secondly, as you can imagine, the connectivity is far from random. Like in larger nervous systems, these computing units take precise roles, part due to the developmental process, part due to later stage learning. "
El Guapo: "Would you say, senor, that I have a plethora of signals in each computing unit? And I just would like to know if you know what a plethora is. I would not like to think that a person would tell someone he has a plethora, and then find out that that person has no idea what it means to have a plethora."
Jefe: "Forgive me, El Guapo. I know that I, Jefe, do not have your superior intellect and education. But could it be that once again, you are angry at something else, and are looking to take it out on me?"
"But in the end, the machinery is precise, and simulating it requires understanding all of it."
Sorry to pick at you for this, but how can you be certain of the many claims you've made here? How do you know that intelligence cannot be implemented in a mechanism simpler than the biological hardware implementation or simulations thereof?
Re:How tiny wasps cope with being smaller than amoebas
by agravier on Saturday July 07, 2012 @02:30AM
(#4210922)
(Did I misuse "plethora"? English is not my first language, sorry if I shouldn't use plethora)
> How do you know that intelligence cannot be implemented in a mechanism simpler than the biological hardware implementation or simulations thereof?
I don't know if intelligence cannot be implemented in a simpler way (I certainly hope it can), I am concerned here about understanding the biological implementation of intelligence. I say that simulations are useful because the models that we may make of the emergence of the mechanisms of intelligence in networks of neurons would be very hard to understand without being implemented and simulated.
However, if you are interested in the artificial implementation of the intelligent behavior of some organisms, you could maybe still benefit from understanding how this intelligent behavior arises in these organisms, and take inspiration from these mechanisms.
> Sorry to pick at you for this, but how can you be certain of the many claims you've made here?
I didn't make revolutionary claims regarding the functioning of biological neural networks. The fact that neurons are sensitive to relative spike timing is evident in mechanisms like spike timing dependent plasticity (http://www.scholarpedia.org/article/Spike-timing_dependent_p...). The "complex chemistry" that I mention is behind cognition is evident if you open any neurology book, for instance Principles of Neural Science by Kandel.
Then, I say that simulation (and in particular simulation of development as well as learning) is the right road to understanding biological neural systems, but I took care to mention that it is what I believe, not what I know.
Re:How tiny wasps cope with being smaller than amoebas
by sp332 on Saturday July 07, 2012 @11:15AM
(#4211816)
Your use of plethora was completely right. For some reason giardini thinks it is a very obscure and "intellectual" word but I disagree. In Google's English corpus it is used about 1/3 as often as the word "neuron". http://books.google.com/ngrams/graph?content=plethora%2Cneur...
Re:How tiny wasps cope with being smaller than amoebas
by sp332 on Saturday July 07, 2012 @11:24AM
(#4211846)
how can you be certain of the many claims you've made here?
It says most of this in the article. e.g. "It turns out that social behavior in the worm is controlled by a pair of neurons called RMG. The two RMG neurons receive input from various sensory neurons that detect the several environmental cues that make worms aggregate. RMG integrates this information and sends signals to the worm’s muscles." You have to understand genetics, smells, sensors, neurons, and muscles before you can explain why worms in nature tend to be together, but worms in the lab stay by themselves.
Re:How tiny wasps cope with being smaller than amoebas
by joeyo on Friday July 06, 2012 @07:16PM
(#4210041)
C. elegans (a type of nematode) is even simpler, with exactly 302 neurons and ~15k synapses. But despite having the complete connectome, there has to date been only limited success at simulating the whole worm. Although see: https://code.google.com/p/openworm/
Re:How tiny wasps cope with being smaller than amoebas
by rcthompson on Friday July 06, 2012 @11:59PM
(#4210683)
Worms (C. elegans specifically) have specific well-documented responses to certain stimuli. You can apply those same stimuli to your simulated worm and see if it responds like a typical real worm.
Re:How tiny wasps cope with being smaller than amoebas
by rcthompson on Saturday July 07, 2012 @03:35PM
(#4212480)
Actually that's pretty much what they are. There us a whole battery of stimulus stimulus-response tests that are essentially used as a regression test suite to figure out what deleterious (or even beneficial) effect a given mutation has. Of course these "tests" must be manually carried out by researchers on live worms.
Re:How tiny wasps cope with being smaller than amoebas
by Someone on Friday July 06, 2012 @03:22PM
(#4209240)
"this wasp can somehow [...] find the right places to lay its eggs"
I bet this wasp is playing the "you do not need eyes to hit bullseye if you throw a million darts" game. It is sufficien t if some of these wasps, almost by accident, happen to lay their eggs in the right place.
Re:How tiny wasps cope with being smaller than amoebas
by Someone on Sunday July 08, 2012 @07:03AM
(#4214315)
Yes, but calling each individual set of a few thousands of neurons freakingly efficient? Together, they manage to survive, but together, tey have many more neurons.
Re:How tiny wasps cope with being smaller than amoebas
by grannyg00se on Friday July 06, 2012 @03:07PM
(#4209185)
I'd love to see this flight in action. I would expect that at their size, they are pretty much limited to going where the primary air current brings them. With perhaps a tiny amount of individual influence.
Re:How tiny wasps cope with being smaller than amoebas
by yoklov on Friday July 06, 2012 @04:28PM
(#4209497)
While I cannot say for certain that neurons are not the only thing responsible for these behaviors, I'm fairly confident in saying that we don't know nearly enough about neurons to assume that 7,400 equates to "pretty simple".
Re:How tiny wasps cope with being smaller than amoebas
by dllthomas on Friday July 06, 2012 @04:56PM
(#4209617)
It's probably "pretty simple" compared to 340,000.
That said, I wonder whether some of the complexity was effectively pushed down into complicating behavior of the individual neurons. If there were strong evolutionary pressures pushing down the number of neurons (as seems likely, for so extreme a reduction) it'd be interesting to see what kinds of hacks were included to get it there.
Re:How tiny wasps cope with being smaller than amoebas
by kjhughes on Friday July 06, 2012 @01:20PM
(#4208710)
I find the implied range of cell sizes to be amazing. (Informally, it's tempting to view all microscopic biological entities as being similarly small; they're not.)
Here's a cool visual of relative cell sizes and scale:
Re:How tiny wasps cope with being smaller than amoebas
by raldi on Friday July 06, 2012 @11:06AM
(#4208037)
What are the major technical barriers before we can identify the input and output channels to this insect's brain and start iterating through all possible input values, recording the corresponding output values? And once we can do that, could we use that data to fly a virtual insect around a virtual world?
This article suggests that it's computationally infeasible even for an organism with only 302 neurons, all of which have already been completely mapped.
Re:How tiny wasps cope with being smaller than amoebas
by vibrunazo on Friday July 06, 2012 @05:32PM
(#4209756)
Honest newbie question: Why would we even want to do that? Exclusively for academic medical purposes? (ie learning how our body works)
It seems to me, that since evolution is highly imperfect, that trying to mimic living beings, might not be the best idea. While we do mimic them a lot, mostly it seems to be for learning until we can do better. But in this case. Since it's so expensive and not viable to mimic them properly. Shouldn't we just try to come up with our own algorithms instead of trying to copy nature's historically bloated algorithms?
That seems to be a lesson we learned from machine learning. I remember when neural networks were first being talked about seriously a decades or so ago. The goal seemed to be to try to mimic neurons just for mimicing neurons sake. Many critics would say we should probably try other learning algorithms that were obviously more efficient. And nowadays we barely see actual neural networks being used seriously in commercial production simply because we have better algorithms that are not trying to emulate nature, just because.
Wouldn't trying to emulate a virtual insect be repeating the same mistake? If all we want is to design a virtual robot that can look for food and control its wings. I sure as hell don't need thousand something emulated neurons to build that.
Re:How tiny wasps cope with being smaller than amoebas
by Bjartr on Friday July 06, 2012 @08:18PM
(#4210229)
>Shouldn't we just try to come up with our own algorithms instead of trying to copy nature's historically bloated algorithms?
People are working on this problem from both sides. AI on one and biological simulation on the other. We don't know which will realize its goals first.
Re:How tiny wasps cope with being smaller than amoebas
by kwekly on Saturday July 07, 2012 @04:13AM
(#4211102)
Because Science, man.
You don't do things in science because they are practical (you just write that on the grant applications), in fact you do many things largely because they are impractical.
It's about wonder and lust for knowledge and all that. It just so happens that the theoretical ground work for all technology piggy backed on this motivation.
Re:How tiny wasps cope with being smaller than amoebas
by tocomment on Friday July 06, 2012 @01:11PM
(#4208640)
I wonder why the Blue Brain guys don't work on c. elegans? They claim they can simulate full neocortical columns, a c. elegans should be no problem and they could compare the behavior.
Re:How tiny wasps cope with being smaller than amoebas
by CamperBob2 on Friday July 06, 2012 @07:01PM
(#4210012)
Arguably, even human brains work that way. You can't really draw a line across part of the CNS and say "This is where the brain stops." The retina, for instance, is almost as much a part of your brain as it is your eye.
By the same token, it's not always easy to classify complex movements as reflexes or thought-guided actions. Cut a chicken's head off while it's walking, and it will keep going for a while. My understanding (IANABiologist) is that the same is true for a human.
Re:How tiny wasps cope with being smaller than amoebas
by awt on Friday July 06, 2012 @12:14PM
(#4208361)
This was one of my first thoughts as well, sort of. Alternatively, is it possible to model each neuron when there are only around 8k? Maybe estimate the visual, audio, and tactile bandwidth of the wasp and feed the simulated neurons a stream of simulated environmental data and just let the connections evolve.
Re:How tiny wasps cope with being smaller than amoebas
by tomp on Friday July 06, 2012 @01:05PM
(#4208607)
There are not many neurons, but there are many (too many) possible connections. To find the right ones, nature took several billion years. Even with the fastest computers, it would take a considerable amount of time (note that the lifetime of these wasps is a few weeks at most, so evolution happens very fast).
Re:How tiny wasps cope with being smaller than amoebas
by dsr_ on Friday July 06, 2012 @01:17PM
(#4208683)
At small enough scales -- and this is one of them -- air is not just a fluid, it is a viscous fluid. Movement will be more like swimming than flying; there won't be any landing or liftoff, so much as grabbing on and pushing off.
Re:How tiny wasps cope with being smaller than amoebas
by rosser on Friday July 06, 2012 @12:48PM
(#4208515)
It's a virtual environment; presumably, one could set the "wall clock" rate of the sim to account for inter-room, or even inter-continental comms latencies.
Re:How tiny wasps cope with being smaller than amoebas
by dllthomas on Friday July 06, 2012 @12:58PM
(#4208558)
The headline is a bit misleading, though. Amoebas seem to be just used as a reference point, where I kept expecting more salience - some adaptation of the wasp to deal specifically with the fact that it was smaller than an amoeba in particular, rather than just with the fact that it was small. Nevertheless, confusion aside, it's fascinating stuff!
Re:How tiny wasps cope with being smaller than amoebas
by riffraff on Friday July 06, 2012 @10:51AM
(#4207962)
this is rather cool but just to nitpick "one single cell" does not always imply "small" there are a few which are visible to the naked eye (think eggs)
Re:How tiny wasps cope with being smaller than amoebas
by tocomment on Friday July 06, 2012 @12:24PM
(#4208420)
Do you have any references for the egg thing? I have a hard time picturing that? Aren't there individual cells inside a chicken egg (before it starts developing?)
Re:How tiny wasps cope with being smaller than amoebas
by robrenaud on Friday July 06, 2012 @11:18AM
(#4208091)
Does anyone know how the nucleus destruction happens? Is there any analogy to regularization/sparsification in machine learning? Is there some kind of process that destroys the nucleus of the least useful neurons?
Re:How tiny wasps cope with being smaller than amoebas
by pygy_ on Friday July 06, 2012 @11:42AM
(#4208210)
The hypothesis advanced by the article is that there is no loss of function. The neurons are packed with enough proteins to function for five days. The nuclei are just dead weight.
In mammals, red blood cells don't have nuclei either and can live up to 90 days in physiologic conditions.
Educated guess resp. nuclei destruction mechanism: probably through partial apoptosis (nucleus fragmentation), autophagia, and/or expulsion and phagocytosis by other cells.
Re:How tiny wasps cope with being smaller than amoebas
by nemo1618 on Friday July 06, 2012 @11:00AM
(#4208002)
Wow, these little guys are incredible! I had no idea such complexity could evolve at that scale. I think these species deserve a mention in science classrooms.
Re:How tiny wasps cope with being smaller than amoebas
by excuse-me on Friday July 06, 2012 @11:29AM
(#4208149)
Well as long as you make it clear that they were created that size because God likes a challenge - rather than any sort of adaptation to their environment - that should be OK
Re:How tiny wasps cope with being smaller than amoebas
by latch on Friday July 06, 2012 @11:05AM
(#4208028)
Badly worded paragraph. I re-read it many times before I understood.
The "both" refers to the Paramecium and the amoeba. It's saying that despite having all those other organs (and neurons), the wasp is actually smaller than the single-celled amoeba and paramecium.
EDIT: Don't delete your comment. You won't be the only one with that question..it'll help others!
Re:How tiny wasps cope with being smaller than amoebas
by PieSquared on Friday July 06, 2012 @11:03AM
(#4208020)
As I understood it, both the Paramecium and the amoeba have a single cell. The wasp has many. (I had to reread that a half-dozen times to figure that out...)
Original: "It’s pictured next to a Paramecium and an amoeba at the same scale. Even though both these creatures are made up of a single cell, the wasp..."
http://en.wikipedia.org/wiki/Xenophyophore http://en.wikipedia.org/wiki/Caulerpa https://en.wikipedia.org/wiki/Valonia_ventricosa
That ridiculously tiny neural network is one freakingly efficient computing device!
To someone more knowledgeable in this subset of biology, is this possible?
I believe that this understanding should not come though imagery alone, but also through studies of the development of these organisms' brains. Like we are now forming artificial neural maps through "machine" learning techniques that are accelerated versions of their biological counterparts, I believe that we should develop developmental algorithms into large-scale simulations. The goals being to first understand how it works, second to see if the models are able to replicate the end result, a good indication that they are useful models.
(I do research in computational neuroscience.)
El Guapo: "Would you say, senor, that I have a plethora of signals in each computing unit? And I just would like to know if you know what a plethora is. I would not like to think that a person would tell someone he has a plethora, and then find out that that person has no idea what it means to have a plethora."
Jefe: "Forgive me, El Guapo. I know that I, Jefe, do not have your superior intellect and education. But could it be that once again, you are angry at something else, and are looking to take it out on me?"
http://www.youtube.com/watch?v=-mTUmczVdik
"But in the end, the machinery is precise, and simulating it requires understanding all of it."
Sorry to pick at you for this, but how can you be certain of the many claims you've made here? How do you know that intelligence cannot be implemented in a mechanism simpler than the biological hardware implementation or simulations thereof?
> How do you know that intelligence cannot be implemented in a mechanism simpler than the biological hardware implementation or simulations thereof?
I don't know if intelligence cannot be implemented in a simpler way (I certainly hope it can), I am concerned here about understanding the biological implementation of intelligence. I say that simulations are useful because the models that we may make of the emergence of the mechanisms of intelligence in networks of neurons would be very hard to understand without being implemented and simulated.
However, if you are interested in the artificial implementation of the intelligent behavior of some organisms, you could maybe still benefit from understanding how this intelligent behavior arises in these organisms, and take inspiration from these mechanisms.
> Sorry to pick at you for this, but how can you be certain of the many claims you've made here?
I didn't make revolutionary claims regarding the functioning of biological neural networks. The fact that neurons are sensitive to relative spike timing is evident in mechanisms like spike timing dependent plasticity (http://www.scholarpedia.org/article/Spike-timing_dependent_p...). The "complex chemistry" that I mention is behind cognition is evident if you open any neurology book, for instance Principles of Neural Science by Kandel.
Then, I say that simulation (and in particular simulation of development as well as learning) is the right road to understanding biological neural systems, but I took care to mention that it is what I believe, not what I know.
It says most of this in the article. e.g. "It turns out that social behavior in the worm is controlled by a pair of neurons called RMG. The two RMG neurons receive input from various sensory neurons that detect the several environmental cues that make worms aggregate. RMG integrates this information and sends signals to the worm’s muscles." You have to understand genetics, smells, sensors, neurons, and muscles before you can explain why worms in nature tend to be together, but worms in the lab stay by themselves.
Edit: Also see the NYT article below.
I bet this wasp is playing the "you do not need eyes to hit bullseye if you throw a million darts" game. It is sufficien t if some of these wasps, almost by accident, happen to lay their eggs in the right place.
That said, I wonder whether some of the complexity was effectively pushed down into complicating behavior of the individual neurons. If there were strong evolutionary pressures pushing down the number of neurons (as seems likely, for so extreme a reduction) it'd be interesting to see what kinds of hacks were included to get it there.
Here's a cool visual of relative cell sizes and scale:
http://learn.genetics.utah.edu/content/begin/cells/scale/
This article suggests that it's computationally infeasible even for an organism with only 302 neurons, all of which have already been completely mapped.
http://news.ycombinator.com/item?id=4208454
It seems to me, that since evolution is highly imperfect, that trying to mimic living beings, might not be the best idea. While we do mimic them a lot, mostly it seems to be for learning until we can do better. But in this case. Since it's so expensive and not viable to mimic them properly. Shouldn't we just try to come up with our own algorithms instead of trying to copy nature's historically bloated algorithms?
That seems to be a lesson we learned from machine learning. I remember when neural networks were first being talked about seriously a decades or so ago. The goal seemed to be to try to mimic neurons just for mimicing neurons sake. Many critics would say we should probably try other learning algorithms that were obviously more efficient. And nowadays we barely see actual neural networks being used seriously in commercial production simply because we have better algorithms that are not trying to emulate nature, just because.
Wouldn't trying to emulate a virtual insect be repeating the same mistake? If all we want is to design a virtual robot that can look for food and control its wings. I sure as hell don't need thousand something emulated neurons to build that.
People are working on this problem from both sides. AI on one and biological simulation on the other. We don't know which will realize its goals first.
You don't do things in science because they are practical (you just write that on the grant applications), in fact you do many things largely because they are impractical.
It's about wonder and lust for knowledge and all that. It just so happens that the theoretical ground work for all technology piggy backed on this motivation.
http://caltech.wormbase.org/virtualworm/
I imagine one can eventully extend it from simply representing anatomy to "activating it".
BTW: some small spiders press their brains not only into their abdomens, but into their legs. e.g. http://news.nationalgeographic.com/news/2011/12/111219-spide... Spiders gotta spin.
By the same token, it's not always easy to classify complex movements as reflexes or thought-guided actions. Cut a chicken's head off while it's walking, and it will keep going for a while. My understanding (IANABiologist) is that the same is true for a human.
http://en.wikipedia.org/wiki/Enteric_nervous_system
Even bigger:
https://en.wikipedia.org/wiki/Valonia_ventricosa
http://en.wikipedia.org/wiki/Egg_yolk
No, the yolk does not "divide", the developing embryo feeds on its content.
In mammals, red blood cells don't have nuclei either and can live up to 90 days in physiologic conditions.
Educated guess resp. nuclei destruction mechanism: probably through partial apoptosis (nucleus fragmentation), autophagia, and/or expulsion and phagocytosis by other cells.
https://en.wikipedia.org/wiki/Poes_law
ps How many christian fundies post on HN anyway?
(reference to "Evolution from Space: A Theory of Cosmic Creationism" by Fred Hoyle)
The "both" refers to the Paramecium and the amoeba. It's saying that despite having all those other organs (and neurons), the wasp is actually smaller than the single-celled amoeba and paramecium.
EDIT: Don't delete your comment. You won't be the only one with that question..it'll help others!
Original: "It’s pictured next to a Paramecium and an amoeba at the same scale. Even though both these creatures are made up of a single cell, the wasp..."