News for hackers. Stuff that matters.
Re:DeepMind and Google: the battle to control artificial int... by melling on Thursday March 14, 2019 @12:05PM (#19390511)
"But human intelligence is limited by the size of the skull that houses the brain."

When you think about it this way, it seems impossible that we haven't duplicated the capability of the human brain in an airplane hangar somewhere.

What's going on inside our heads that we can't mimic? That magical algorithm...

Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @01:11PM (#19391235)
If you poke at a real brain, it’s almost fractally complex.

Single ion channels can have surprisingly complicated behaviors that depend on their current state and past history. Individual neurons contain tons of these channels, and can do a lot of powerful computation on their own. Of course, there are 86 billion neurons and combinatorically more connections between them. That’s just the neurons too; God only knows what the glia cells, which outnumber them 10:1, are doing but they’re a lot less passive than many have thought.

On top of this, there’s a whole separate but overlaid network of neuromodulators (hormones, nitric oxide, etc). Electric fields produced by some neurons may even influence the activity of others.

None of this is static, either. Things change on timescales ranging from milliseconds to years, and in response to all sorts of external stimuli.

The brain is bonkers.

Re:DeepMind and Google: the battle to control artificial int... by est31 on Thursday March 14, 2019 @01:22PM (#19391348)
The coolest part about this is probably how little energy it needs. It's about 20 Watts. Current node sizes are already smaller than axon diameters. If it weren't for power, we could probably scale up manufacturing processes of current semiconductor technology to build giant room sized chips but we simply wouldn't be able to cool those things. Instead we are forced to wrap a ton of metal around them and plastic and air and provide extensive cooling.
Re:DeepMind and Google: the battle to control artificial int... by FartyMcFarter on Thursday March 14, 2019 @04:00PM (#19392996)
Is it true that a big part of this efficiency is due to using analog signals and not digital? I recall reading that, but it's far from my area of expertise.

Digital has many advantages: a digital Einstein could be replicated perfectly, not so for an analog Einstein.

Re:DeepMind and Google: the battle to control artificial int... by wuliwong on Thursday March 14, 2019 @01:29PM (#19391416)
Well said. This is my line of thinking when comparing current AI to the human brain.
Re:DeepMind and Google: the battle to control artificial int... by mac01021 on Thursday March 14, 2019 @12:48PM (#19390999)
Similar things have been or are being tried (eg https://en.wikipedia.org/wiki/Blue_Brain_Project).

But the _precise_ capabilities of a human brain are not actually what we want.

For starters, an infant's brain does not have any immediately valuable capabilities.

After that brain is exposed for several years to signals propagating through the brain's host body from the surrounding environment, it has developed many interesting capabilities. But those capabilities are only meaningful in the context of the input stream that the brain has learned to interpret.

So if you want your software simulation of a brain, running on a hangar-sized computing cluster, to perform human grade cognition, then you'll have to provide it with a signal as rich as and of the same form as the signal that we receive on a continual basis through our 1 billion sensory cells (optical, auditory, proprioceptive, etc).

And in order to supply that signal in a realistic way, you'll have to simulate the environment in such a way that it responds to motor output from the simulated brain. (Or you can use the real environment, but then you have to have the brain operate a complete synthetic human body).

All this is a tremendous technical challenge, outlandishly expensive and, even when achieved, does not immediately enhance our understanding of how naturally intelligent systems process information. Nor does it provide us with a means to construct specialized intelligent agents that operate in the world, whether autonomous vehicles, burger flippers, surgeons, or stock brokers.

Re:DeepMind and Google: the battle to control artificial int... by arisAlexis on Friday March 15, 2019 @05:44AM (#19398100)
how about watching all movies and all internet media?
Re:DeepMind and Google: the battle to control artificial int... by zipzap324 on Thursday March 14, 2019 @12:26PM (#19390760)
Modern supercomputers are still a factor of 10 off of the brains compute power(~1 Exaflop) but I don't think anyone in the field believes that you suddenly get consciousness once you reach a critical mass of compute. It's clearly a software problem.
Re:DeepMind and Google: the battle to control artificial int... by ZhuanXia on Thursday March 14, 2019 @12:37PM (#19390875)
Estimates vary over many orders of magnitude: https://aiimpacts.org/brain-performance-in-flops/
Re:DeepMind and Google: the battle to control artificial int... by zipzap324 on Thursday March 14, 2019 @12:43PM (#19390938)
~1 Exaflop leaves room for error.
Re:DeepMind and Google: the battle to control artificial int... by ZhuanXia on Thursday March 14, 2019 @12:46PM (#19390968)
I suppose my point is I distrust your certainty. It's quite possible 20 petaflops may be enough. Maybe we will need many exaflops. We don't really know.
Re:DeepMind and Google: the battle to control artificial int... by tim333 on Thursday March 14, 2019 @07:30PM (#19394968)
Moravec's estimate which seems quite well reasoned puts it much lower, about 100 terraflops which you can now get in a GPU https://www.scan.co.uk/products/pny-nvidia-tesla-v100-16-gb-...

It's true they have not suddenly become conscious.

Re:DeepMind and Google: the battle to control artificial int... by melling on Thursday March 14, 2019 @12:32PM (#19390820)
A factor of 10? That's it. It's as good as done within 5-7 years.

https://www.sciencemag.org/news/2018/02/racing-match-chinas-...

Re:DeepMind and Google: the battle to control artificial int... by Barrin92 on Thursday March 14, 2019 @10:45PM (#19395993)
It's not necessarily about a magical algorithm but about the richness of information that can be processed by analog, biological devices.

The amount of information stored and being processed by single individual cells is almost unimaginable. Individual brain cells are likely able to learn high level abstract features store memory, modulate responses in intensity and length through thousands of transmitters and so on. Single celled organisms, like amoeba, possess the ability to emulating 'hunting' and other complex behaviour.

Re:DeepMind and Google: the battle to control artificial int... by gumby on Thursday March 14, 2019 @07:49PM (#19395088)
> "But human intelligence is limited by the size of the skull that houses the brain."

It's actually not. Humans are unusual in that they can teach each other and institutional knowledge can span generations. In addition, just as your speed of travel is not limited by the length of your legs and the ATP cycle, your intelligence is not limited by your brain.

Re:DeepMind and Google: the battle to control artificial int... by gumby on Thursday March 14, 2019 @07:47PM (#19395076)
Think of it as a 100 Hz computer with 80 giganodes and a fanout from those nodes of up to 10^5. That's a lot of computation!
Re:DeepMind and Google: the battle to control artificial int... by Symmetry on Thursday March 14, 2019 @02:26PM (#19391954)
Imagine if marsupials, not limited by the size of the birth canals, had produced an intelligent species. Or birds. Especially since birds have the same linear relationships between brain size and neuron count that primates do.
Re:DeepMind and Google: the battle to control artificial int... by modzu on Thursday March 14, 2019 @12:31PM (#19390811)
this is wrong. look at the size of an elephant brain. they are smart, but not smarter than humans. similarly, bird brains are tiny, but birds have shown significant intelligence, crows in particular have been well studied.
Re:DeepMind and Google: the battle to control artificial int... by gipp on Thursday March 14, 2019 @01:04PM (#19391163)
There are many other factors at play, yes, but physical size does impose information-theoretic upper bounds on its processing power. Bounds we're nowhere near probably, but still they are there.
Re:DeepMind and Google: the battle to control artificial int... by melling on Thursday March 14, 2019 @12:38PM (#19390885)
The point is that we're trying to duplicate something with the ability of the human brain, and we aren't constrained by size. We can cheat (e.g. 1,000,000 times bigger with 1,000,000 times the power, etc). We're just missing an algorithm or two.
Re:DeepMind and Google: the battle to control artificial int... by modzu on Thursday March 14, 2019 @01:00PM (#19391126)
ah yes, it's true we can keep adding on processors and memory until we go beyond what's in the brain (i think currently deep mind has ~ 11 billion neurons to our 100 billion), and indeed so far it's helping, but my point is that it's not at all clear that "more = better". there is more complexity involved than simply scale. the machine could become schizophrenic for exmaple (seriously).
Re:DeepMind and Google: the battle to control artificial int... by riku_iki on Thursday March 14, 2019 @06:18PM (#19394416)
> in the brain

you focus only on single brain, when really we need to look at many trillions brains and experiments with complex reward function(real world): billion years of evolution * billions of various creatures born and died within every year. All this giant sequence of experiments converged to current human brain.

In ML terms: to achieve result similar to human brain we need to run that many hyperparameter optimization trials. Or find some better shortcuts than human brain biological structure.

Re:DeepMind and Google: the battle to control artificial int... by vl on Thursday March 14, 2019 @07:29PM (#19394962)
This is not a best way to compare it: brain neurons do orders of magnitudes less operations per second. Current Google's TPU clusters are 10 petaflops, with new ones being 1 exoflops. We can estimate 100Hz frequency for brain, so 100 * 10^11 = 10^13 "neuron operations". Let's estimate 1000 flops to simulate single neuron. So it gives us 10^16 flops for brain (aka 10 petaplops). I.e. Google's new deployments are more powerful than single brain.
Re:DeepMind and Google: the battle to control artificial int... by modzu on Thursday March 14, 2019 @09:28PM (#19395655)
and what says that is the best way to compare it? neural networks don't model anything but the electrical synapse. there's much more going on (cf: chemical synapse). also speed isn't the holy grail: too fast in a human brain and you get seizures. why? it could be that as these systems scale up magical things happen. but it's a conjecture -- something we will discover, and not something we know.
Re:DeepMind and Google: the battle to control artificial int... by clanrebornx on Thursday March 14, 2019 @12:26PM (#19390753)
We know nothing about how it works, it seems to derive its information and results from somewhere else as if it's hooked some bigger brain ( which can't see ), so analyzing brain alone we don't find anything.
Re:DeepMind and Google: the battle to control artificial int... by zipzap324 on Thursday March 14, 2019 @12:27PM (#19390775)
This is inaccurate. We understand much of how it works, how vision, speech, etc work but we don't understand consciousness which is quite different.
Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @12:56PM (#19391073)
Nonsense.

I’m an actual, working neuroscientist and if we’ve solved any of these things, it would be news to me (and everyone else at my institute). We have good, if coarse, knowledge of which structures are critical for which functions—-at least under some conditions. Our knowledge of how they do this is even cruder: neither the representations nor the algorithms are known with much certainty, let alone how they arise.

Let me give you a very concrete example of where we are. There’s a small nemode called C. elegans. It’s about a millimeter long and has 302 neurons. We know its complete wiring diagram, its genome, and the origin and fate of every cell (not just the neurons) in its tiny, simple body. Its behavior has been studied extensively. And yet...we can’t accurately simulate the damn thing—-and it’s not like it does a lot to begin with.

The human brain has about 86B neurons, and we know an awful lot less about them. Neither vision nor speech is remotely close to “solved” or understood. Consciousness, even in the very limited sense of “why do we fall asleep—-or need to?” is a mote off in the distance.

Re:DeepMind and Google: the battle to control artificial int... by zipzap324 on Thursday March 14, 2019 @12:58PM (#19391108)
Where did I say anything about simulating? Are you really saying that we understand nothing about how vision works?

Also a 10 second google search pulls up papers with plenty of details about vision in the brain so I don't know why you're talking about it as if its some great mystery.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4574956/

A 1800 Page textbook on Vision Neuroscience. I'll leave it to HN to decide if we "Understand" Vision. Arbitrarily high requirements for understanding are being thrown about that would leave modern science in shambles if applied. https://mitpress.mit.edu/books/visual-neurosciences-2-vol-se...

Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @01:30PM (#19391434)
I have a PhD in visual neuroscience, so yeah, I’m pretty comfortable saying we don’t know how it works.

We know a lot of facts, and we have some ideas about how various small things are implemented, but in terms of grand unifying theories, we’re nowhere close.

For example, suppose I showed you two gratings (think zebra stripes): a small patch and a larger one. Under some circumstances, you’ll have a harder time determining which way the big patch is oriented vs. the small one. This is true even though there’s extra information in the big patch. We think this is related to a phenomena called surround suppression, but they’re not exactly the same....and no one can agree on how surround suppression is implemented, let alone what it’s good for. This happens in primary visual cortex, which is probably the simplest—-and most extensively studied—of the visual cortical areas.

Re:DeepMind and Google: the battle to control artificial int... by 0-_-0 on Friday March 15, 2019 @10:42AM (#19400114)
It's quite unrelated, but I've been wondering something about neuroscience grammar: Why is it "in primary visual cortex" and not "in _the_ primary visual cortex"?
Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Friday March 15, 2019 @04:01PM (#19403657)
I'm not sure!

Your innocuous question has kicked off a pretty feisty debate on my floor about whether it is 'primary' as in first (either in the circuit or evolutionarily) or primary as in most important.

If it's the former, adding a "the" seems to add some unwarranted emphasis. I think there's probably some parallelism too. Primary visual cortex is also called "V1" (as in the first cortical area involved in vision) or "Area 17" (according to a map that defines areas based on their cellular organization). While "in the primary visual cortex" sounds fine, "in the V1" and "in the Area 17" sound barbarous.

Re:DeepMind and Google: the battle to control artificial int... by primo44 on Friday March 15, 2019 @02:17PM (#19402571)
And just regular grammar. "Phenomena" is plural.
Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Friday March 15, 2019 @06:12PM (#19404791)
Got nothing for that one :-)
Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @02:18PM (#19391883)
Re: the book added in your edit. I have it right in front of me.

As I said before, we know a lot of facts. We know a lot about the spectral sensitivity of rods and cones, and the molecular mechanism that lets them turn photons into electrical impulses. We know a little bit about where the areas that process faces are and what visual features the neurons in them respond to. We’ve got pieces, but they’re not put together.

I would say that we understand vision when we can answer a question like “How do you find a friend in a crowd?”

You can start with “When you first met, light bounced off her face and isomerized some retinal from its 11-cis to all-trans form, which caused the bound opsin to change conformation into metarhodopsin II, which activated transducin, which....” Eventually, this cascade caused electrical activity that reaches cortex. A huge set of cortical areas process visual input, and these electrochemical signals flow through all of them. We can predict V1 neurons’ activity reasonably well, less so for the downstream neurons in V2, V4, or the temporal lobe areas. We have only the fuzziest ideas how those patterns are read out, tagged as important to remember, and moved into memory. You've only just met--and yet it gets worse.

To find her, you’ve got to retrieve those patterns from memory (no one knows how, but oscillations might be involved?), and use them to search in a way that’s robust against variations in the friend’s pose, position, rotation, illumination, and even dress style or age, many of which you have never seen before and will never see again. We know, for example, that some cells in IT are fairly robust against some moderate kinds of image changes. Some but not all, of this is done by circuits that look like a convNet. Whether this is a coincidence or not is debatable and how this convNet is trained is a total mystery—-it’s definitely determined by experience, but the feedback signals needed for vanilla backprop are missing.

As you scan the crowd, you’re only getting high-resolution data from a very small part of the visual field. This is (somehow) stitched together into a unified percept. You apply various heuristics—maybe your friend favors bright colors—to speed the search along. How you learn these, and how they’re mixed in with the input from your eyes is unknown, but it’s certainly reflected in your behavioural output: you'll find her faster if you successfully predict what she looks like, and you'll be much slower if you guess wrong. Perhaps you hear a familiar voice or smell the perfume you bought her. This, too, can help you find her, but how information is integrated across senses is unknown too.

Eventually, you find her. You plan a path across the plaza towards a cafe. We have a pretty good understanding of how this works in rats (3-7 Hz oscillations coordinate place cells and grid cells in the hippocampus). Those oscillations are really strong in rodents, but much weaker in monkeys and totally missing in bats, so it's not clear how this works in humans.

Now all you’ve got to do is open your mouth and order coffee....

Re:DeepMind and Google: the battle to control artificial int... by johnsimer on Thursday March 14, 2019 @02:40PM (#19392127)
just curious - how do neuroscience people and people of non-CS fields find out about HN?
Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @03:42PM (#19392823)
A lot of bio stuff now generates huge amounts of data and needs computational skills to collect and interpret. My undergrad degree was in CS and I still split my time between training animals and training models (plus writing and, today, RAID-babysitting).

We get about 1 Gb/min of neurophysiological data (x4-6 hours/day) and I'm hoping to scale that up quite a bit soon. People doing microscopy also generate giant datasets, as do the sequencing folks.

Me, specifically? A labmate showed me and said "It's cool...and a timesink."

Re:DeepMind and Google: the battle to control artificial int... by jcims on Thursday March 14, 2019 @10:53PM (#19396025)
Just wanted to thank you for wading in here sand sharing your perspective.
Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @11:14PM (#19396123)
You're welcome! Random interesting stuff is what makes the internet worth keeping around, after all :-)
Re:DeepMind and Google: the battle to control artificial int... by HNLurker2 on Friday March 15, 2019 @01:24AM (#19396830)
Many neuroscientist turn to teaching mindfulness (e.g Sam Harris) because in their spiritual journey and academic neuroscientist journey they ask : Who am I?

What do you think about this? Who is the I? Where can I find it? Is it just mysticism?

Re:DeepMind and Google: the battle to control artificial int... by mrep on Thursday March 14, 2019 @07:01PM (#19394762)
Ever read the book "On Intelligence" by Jeff Hawkins and if so, what are you thoughts on it? I've read that and ray kurzweil's books and On Intelligence was my favorite and got me super interested in AI but I haven't done much with it so I'm curious what someone who has a PhD in neuroscience thinks of it.
Re:DeepMind and Google: the battle to control artificial int... by beefcafe on Thursday March 14, 2019 @07:44PM (#19395064)
Also “How to Build a Brain” by Chris Eliasmith. Interesting theories on how neurons represent functions and then build into a greater whole. I’m not a neuroscientist but my intuition says he might be getting closer to a solid mid-level (above the level of ion channels) understanding of brain function.
Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @11:16PM (#19396132)
I haven't, though it's been on my list for a while.

I'm collaborating with a woman who has also been working with him to model some of our data with NENGO, so I should really get around to that sooner rather than later.

Re:DeepMind and Google: the battle to control artificial int... by loamseed on Thursday March 14, 2019 @04:48PM (#19393542)
Are there publicly available repositories of this kind of data? Where?

What are the best modern methods to analyze them?

Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @05:46PM (#19394127)
Yup. The neuroimaging folks are really good about sharing data. If you want to look at MRI/MEG/EEG data, https://openneuro.org might be a good place to start.

CRCNS (https://crcns.org/data-sets) has some neurophysiology data (i.e., from implanted or inserted electrodes). This sort of data is shared a little less often, in part because it's often acquired and stored in weird, homebrew formats, though that's slowly changing.

ModelDB (https://senselab.med.yale.edu/ModelDB/) has a large collection of computational models. These are mostly biophysical models, though there's some other stuff in there too.

Depending on what you're looking for, there are other more specialized repositories. NDCT (https://data-archive.nimh.nih.gov/ndct) has mental-health related clinical trial data, though you'll have to do some paperwork if you want subject-level data, which is fairly common for clinical data. MIT has a collection of eye movement data sets: http://saliency.mit.edu/datasets.html

As for the best methods, this comment box is far too small to contain all my thoughts on that :-) It depends on your question and experiment. Sometimes, all you really need is a t-test (or the randomized version), but that requires getting the experiment just right. Other times, you might need a morass of signal processing and dimensionality reduction, fed into some giant multi-level Bayesian model in a vain attempt controls for all the stuff you neglected when you designed the damn experiment. Happy to send you some pointers if you have something specific in mind though!

Physics has historically had a huge leg up on the other sciences because they had real models that made testable, quantitative predictions. We're finally starting to learn enough about the brain that we can do this for neural data too, and I'm really excited about that!

Re:DeepMind and Google: the battle to control artificial int... by loamseed on Saturday March 16, 2019 @07:52PM (#19411204)
Thank you for this wealth of information!

I will definitely look through, and after digging around a bit I'd love to get some pointers. I have been curious about this for a long time, but uncertain where to look, so this is very exciting. Thank you again :)

Re:DeepMind and Google: the battle to control artificial int... by codekilla on Thursday March 14, 2019 @04:39PM (#19393446)
what sorts of tools are you using to deal with this data?
Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @05:21PM (#19393891)
It's a hodgepodge.

Mostly Matlab, Python, and R, with a few things that have tight time/memory requirements in C++. Matlab was really popular in neuroscience for a very long time, so we still have a lot of code in m-files, but most labs are moving towards Python (and a few towards R).

The code quality varies a lot. Some of our "core" stuff is great, but there's also a lot of stuff that was written quickly and meant to be run once ("let's just try it"), which is cold comfort when you find it years later.

People also come in with varying levels of programming skill. I'm going to try to do actual code reviews with the undergrads this summer to see if we can't make our stuff a little less embarrassing.

Re:DeepMind and Google: the battle to control artificial int... by codekilla on Thursday March 14, 2019 @07:18PM (#19394884)
I can't reply to your last comment...but yes..anything dealing with time series it's easily the best in the world. In a past life long ago I worked in finance and heard about it then. Recently, I was thinking about simulations and how to maybe deal with and analyze the timeseries data and I thought about it. Apparently, NASA is experimenting with it at their Ames Frontier Development Lab, astrophysics data is huge. Anyway, I am just kicking the tires at this point and trying to find ways to implement and play around with it a bit. If you or anyone you know develops an interest, feel free to drop me a line. grantroy _@_ caltech dot edu
Re:DeepMind and Google: the battle to control artificial int... by codekilla on Thursday March 14, 2019 @06:18PM (#19394420)
I'm interested in using kdb+/q for applications dealing with large scale scientific data. Do you think there would be much interest in the neuroscience community?

I'll add, I work in a lab and have seen the stuff of nightmares myself.

Re:DeepMind and Google: the battle to control artificial int... by mattkrause on Thursday March 14, 2019 @07:08PM (#19394815)
Possibly! I've not played with the time series databases much. Most of our queries would be something like "give me signals from channels A-C that are +/- 1 second from all events of type X." If it would help with something like that, it'd be great.
Re:DeepMind and Google: the battle to control artificial int... by thereisnospork on Thursday March 14, 2019 @01:11PM (#19391239)
We understand lots about how the brain behaves, we understand next to nil about how it behaves that way.

we can't describe how vision, eg, is processed at a molecular or even cellular level, ergo we know nothing.

Re:DeepMind and Google: the battle to control artificial int... by arendtio on Thursday March 14, 2019 @12:47PM (#19390984)
Well, maybe it just doesn't exist and my Roomba is as conscious as me.
Re:DeepMind and Google: the battle to control artificial int... by Brifer on Thursday March 14, 2019 @02:25PM (#19391943)
This made me ponder.
Re:DeepMind and Google: the battle to control artificial int... by wuliwong on Thursday March 14, 2019 @01:26PM (#19391384)
You responded to hyperbole with with a vague and imprecise statement. I will admit it is more accurate since "much" is somewhere between "everything" and "nothing".
Re:DeepMind and Google: the battle to control artificial int... by narrator on Thursday March 14, 2019 @02:04PM (#19391753)
Protein folding is still an exponential time algorithm when done inside a computer and biological systems do this in constant time, massively, in parallel.

Determining whether a molecule is an agonist takes a long time to calculate. I've heard the complexity is O(N^3). Biological systems do this in constant time, trillions of times a second in parallel.

If you could simulate biological systems easily, you could do drug development completely inside a computer.

Re:DeepMind and Google: the battle to control artificial int... by fwip on Thursday March 14, 2019 @06:57PM (#19394731)
I'm concerned that you're ascribing unique characteristics to biological systems, when in fact we see the same characteristics in almost any natural system. Biological systems don't solve protein folding. Proteins fold in biological systems.

Fluids take an enormous amount of computing power to simulate correctly. But water isn't smart, it just does what water does. Heck, the N-body problem is a classic O(n^2) algorithm, but we don't say that the planets and stars are "solving" it.

Re:DeepMind and Google: the battle to control artificial int... by narrator on Thursday March 14, 2019 @08:42PM (#19395376)
These techniques have already been used to solve problems using DNA computing [1]. Digital circuits don't solve anything either, they are just electrons flowing around mediated by semiconductors after all and the results of their computation are just measurements of electrical charge values after those physical systems have had time to flow around. As long as you can set the input and get a consistent output and measure that output you can compute with it.

To use your logic: Large integrated circuits take an enormous amount of computing power to simulate correctly. But integrated circuits aren't smart, they just do what integrated circuits do.

[1]https://en.m.wikipedia.org/wiki/DNA_computing

Re:DeepMind and Google: the battle to control artificial int... by alphagrep12345 on Thursday March 14, 2019 @05:07PM (#19393721)
So are you saying that we need not build bigger networks with huge data, but rather have better algorithms with significant parallelization? Sounds like we're back to symbolic AI again!
Re:DeepMind and Google: the battle to control artificial int... by narrator on Thursday March 14, 2019 @05:47PM (#19394140)
New computing architectures like quantum computing could simulate these systems far more efficiently than classical architectures -- in theory. The engineering still needs more work though.

Also, new AI techniques are good at finding good enough equivalents to exactly replicating human cognition for many things, but that might get harder as the problems become even more general.