News for hackers. Stuff that matters.
Re:The Myth of a Superhuman AI by _greim_ on Wednesday April 26, 2017 @07:48PM (#14208033)
> Temperature is not infinite [...] There is finite space and time. Finite speed.

Just want to point out this is true, however these things go astronomically high.

> what evidence do we have that the limit is not us?

We can measure the speed impulses travel through neurons, and compare that to, say, the speed of electrical impulses through silicon or light through fiber.

We can find the maximum head-size that fits through a vaginal canal, or the maximum metabolic rate a human body could support, and try to determine if these factors imposed any limitations on intelligence during human evolution.

We can look at other evolved/biological capabilities, like swimming or flying, and compare them to state-of-the-art artificial analogs, and see if a pattern emerges where the artificial analogs tend to have similar limitations as their biological counterparts.

Re:The Myth of a Superhuman AI by andrepd on Wednesday April 26, 2017 @10:56PM (#14208839)
> Temperature is not infinite [...] There is finite space and time. Finite speed.

There's no theoretical limit for temperature, and we believe spacetime could be infinite even though the observable universe is not. Nevertheless this is a very silly argument. If it's finite but absurdly high it's good enough for the purpose.

Re:The Myth of a Superhuman AI by adrianN on Thursday April 27, 2017 @03:28AM (#14209832)
If the energy density in a fixed volume of space gets too high it collapses into a black hole. That seems to suggest that there is a kind of limit to temperature.
Re:The Myth of a Superhuman AI by pitaj on Thursday April 27, 2017 @01:57PM (#14213464)
Only if it's concentrated. Otherwise the entire universe would have collapsed into blackholes during the big bang. You need an energy gradient for gravity to work like that.
Re:The Myth of a Superhuman AI by GotAnyMegadeth on Thursday April 27, 2017 @05:36AM (#14210271)
I'm a complete noob in this area, but that doesn't mean that temperature has reached it's limit does it? The black hole can carry on getting more dense and hotter.
Re:The Myth of a Superhuman AI by adrianN on Thursday April 27, 2017 @05:46AM (#14210308)
No, the black hole can't get more dense. If you put more energy into it it gets bigger.
Re:The Myth of a Superhuman AI by ben_w on Thursday April 27, 2017 @05:55AM (#14210340)
Schwartzchild radius is directly proportional to mass, so (if I understand correctly) it's if the energy density of a surface area rather than of a volume is too high.
Re:The Myth of a Superhuman AI by libertymcateer on Thursday April 27, 2017 @09:26AM (#14211269)
Yes, there is a theoretical limit for temperature.

https://en.wikipedia.org/wiki/Absolute_hot

For all intents and purposes, however, it is preposterously enormous.

Re:The Myth of a Superhuman AI by jessriedel on Thursday April 27, 2017 @09:39AM (#14211350)
That's not a limit for how hot temperature can get, just a limit at which existing theories break down.
Re:The Myth of a Superhuman AI by andrepd on Thursday April 27, 2017 @05:23PM (#14214830)
No, there's not. Read what you posted more carefully. Planck temperature is the scale at which gravitation becomes as important as other forces, and thus without a working theory of quantum gravity we can't predict what happens at that scale.
Re:The Myth of a Superhuman AI by Arcane_NH on Wednesday April 26, 2017 @11:44PM (#14209031)
Re:The Myth of a Superhuman AI by leni536 on Thursday April 27, 2017 @10:27AM (#14211672)
Planck length, Planck time and Planck temperature are not the minimal/maximal values for these quantities that "could exist". It is the boundary of the regime that our current theories can describe.
Re:The Myth of a Superhuman AI by thomasahle on Wednesday April 26, 2017 @11:34PM (#14209005)
> There's no theoretical limit for temperature

I suppose when the particles reach lightspeed?

Re:The Myth of a Superhuman AI by thomasahle on Thursday April 27, 2017 @11:29PM (#14216694)
I see that I am mistaken: The temperature is a function of the particles energy, not its speed. The energy at light speed is infinite, so that doesn't really pose a temperature limit.

There does however seem to be an quite widely assumed maximum temperature: the Planck temperature of about 1.417×10^32 Kelvin.

Re:The Myth of a Superhuman AI by killjoywashere on Wednesday April 26, 2017 @11:59PM (#14209077)
The archtype of temperature is a black body radiator. Classically, you make a block of metal (ceramic, whatever), with a spherical cavity and drill a small hole into the cavity. Then you draw a vacuum and heat the cavity, point a scope at the hole, and measure the spectrum of ligh tcoming out. In this circumstance, there is no mass that limits the energy: you are measuring the temperature of a black, empty vacuum; thus there is no upper limit.
Re:The Myth of a Superhuman AI by jahnu on Thursday April 27, 2017 @02:47AM (#14209672)
> Then you draw a vacuum and heat the cavity

What are you heating if it's a vacuum? How can you heat nothing?

Re:The Myth of a Superhuman AI by TeMPOraL on Thursday April 27, 2017 @04:58AM (#14210138)
You're measuring radiative heat, which indeed exists for most of its time in nothing. I guess that the idea of GP is that you could make the heating block arbitrarily big (say, size of the universe) and have it dump all its radiative heat into that cavity.
Re:The Myth of a Superhuman AI by jahnu on Friday April 28, 2017 @02:02PM (#14221647)
I see. Thanks.

The difficulty here is people don't often specify if they mean heat in the form of kinetic energy or radiation.

Much like how people say things like "releasing energy" without specifying the form of energy.

Re:The Myth of a Superhuman AI by dTal on Thursday April 27, 2017 @08:30PM (#14216000)
I'm sorry, but this is a complete misapprehension of "black body" radiation and your experiment is nonsensical. "Black body" refers to an object that absorbs all incoming radiation, and nothing to do with the "a black, empty vacuum". The spectrum of such an object therefore is entirely radiative (no reflection) and depends only on its temperature. As a sibling points out, a vacuum cannot be heated - there is nothing to heat - and does not have an emission spectrum. Your experiment would simply measure the spectrum of the bottom of the hole you drilled.
Re:The Myth of a Superhuman AI by zeroer on Thursday April 27, 2017 @05:28AM (#14210233)
When you heat something, you have to add energy to it. Mass and energy are equivalent; both warp spacetime. You will, in fact, reach a temperature where your block of metal collapses.
Re:The Myth of a Superhuman AI by killjoywashere on Thursday April 27, 2017 @10:17AM (#14211604)
I was simply trying to explain to my P that temperature is not dependent on the speed of a massive particle.
Re:The Myth of a Superhuman AI by zeroer on Thursday April 27, 2017 @04:45PM (#14214542)
OK, but arbitrarily high temperatures necessitate arbitrarily high mass-energy densities, and the latter won't happen without a gravitational collapse.
Re:The Myth of a Superhuman AI by DubiousPusher on Wednesday April 26, 2017 @08:35PM (#14208256)
I think a compelling argument is the variance in intelligence among humans themselves. A cabal of AIs 2x as intelligent as your average "genius" could be quite formidable were they to decide to act against the favor of humankind.
Re:The Myth of a Superhuman AI by adamlett on Thursday April 27, 2017 @01:31AM (#14209389)
Yes, this is why the nerds rule over the jocks in high school. Oh, wait…
Re:The Myth of a Superhuman AI by Qwertious on Thursday April 27, 2017 @03:21AM (#14209802)
That's different, because there are specific rules against arms races in schools, that people typically adhere to. If there was a battle scheduled in advance, I'd bet on the nerds.

But what's more, if they both have guns then everything's about even. Strength doesn't really help if you've been shot, and most high-schoolers don't have much experience shooting guns.

Re:The Myth of a Superhuman AI by ghaff on Thursday April 27, 2017 @09:20AM (#14211216)
>most high-schoolers don't have much experience shooting guns

Actually a lot do but probably not so much in the places that readers/commenters here live.

Re:The Myth of a Superhuman AI by TeMPOraL on Thursday April 27, 2017 @05:02AM (#14210148)
They don't win in high school. But later in life, jocks find themselves employed by nerds.
Re:The Myth of a Superhuman AI by Retra on Wednesday April 26, 2017 @09:14PM (#14208432)
But anyone half that smart would know not to give an unproven system absolute, unchecked control over their critical infrastructure, which would basically be a requirement to causing problems humans can't easily overcome.
Re:The Myth of a Superhuman AI by manicdee on Wednesday April 26, 2017 @09:57PM (#14208616)
The Machines will come to control our infrastructure through a series of small decisions that seemed like a good idea at the time.

Computer control of farming decisions such as watering and fertilising. Link that in with insolation and wind prediction to minimise waste or maximise productivity.

This happens in the cloud thanks to insolation prediction being tied into wide-area networks of solar farms.

More such networks evolve independently, then one day some bright spark realises that prediction and control in domain X can be combined with control and prediction in domain Y to produce greater efficiencies.

Linking reproductive health and food production to maximise water savings, for example.

Next thing you know the computers decide that human population is best maintained in the order of hundreds of millions rather than billions.

And then we find out that Terminator was actually propaganda from the human rebels who didn't like the computers telling them not to breed, and the nuclear war was Skynet protecting its desired humans from the rebels, not protecting itself.

Re:The Myth of a Superhuman AI by nradov on Thursday April 27, 2017 @12:44AM (#14209226)
The limiting factor in farm productivity is not decision making by human farmers. Anyone who has been farming for years already makes pretty close to optimal decisions based on the available data about crop prices, weather, soil status, labor rates, etc. The ones who make bad decisions end up bankrupt, and leave farming or work as hired farmhands. And there are so few decision-making farmers left anyway that automating the decision making part of their jobs won't achieve any meaningful cost savings.
Re:The Myth of a Superhuman AI by alexwebb2 on Thursday April 27, 2017 @10:25AM (#14211657)
> Anyone who has been farming for years already makes pretty close to optimal decisions based on the available data about crop prices, weather, soil status, labor rates, etc.

I'm not sure if you're including software analysis in your notion of "based on the available data", but if not, then this would absolutely not be true - unaided humans, even veteran growers who've been managing the same fields for decades, do not make anywhere close to optimal decisions. They make good ones, generally, and can be long-term profitable with relative ease, but it's absolutely not even close to what you get when you bring intelligent software into the mix.

Re:The Myth of a Superhuman AI by nradov on Thursday April 27, 2017 @11:48AM (#14212371)
Sure of course good farmers are taking advantage of the best available software analysis tools. The point is that those tools already work well enough that even if superhuman AI actually becomes available at some point (and that might never happen) it won't necessarily make any better decisions than what human farmers are already doing today.
Re:The Myth of a Superhuman AI by kpil on Thursday April 27, 2017 @01:30AM (#14209384)
Maybe Amazon will own 90% of the farms because the have the cheapest robots and best algorithms and statistics.
Re:The Myth of a Superhuman AI by nradov on Thursday April 27, 2017 @01:51AM (#14209458)
John Deere and their competitors are far, far ahead of Amazon.com in farm automation. There's a huge difference between warehouse picking robots and farm equipment. Being cheaper doesn't matter, it's ROI that counts.
Re:The Myth of a Superhuman AI by Danihan on Thursday April 27, 2017 @11:25AM (#14212181)
Except Amazon could easily acquire John Deere.
Re:The Myth of a Superhuman AI by ShannonAlther on Thursday April 27, 2017 @01:02PM (#14213032)
Just briefly scanning the numbers on Wikipedia, Amazon.com could acquire John Deere, but it'd be highly unlikely unless they expected that a change in management would yield implausibly high returns.
Re:The Myth of a Superhuman AI by Danihan on Thursday April 27, 2017 @01:34PM (#14213280)
I suppose my point is, they could acquire the knowledge needed to do cutting edge farm automation if that's something they wanted.

And it should be something they want.

Re:The Myth of a Superhuman AI by nradov on Friday April 28, 2017 @10:16AM (#14219536)
I'm sure Jeff Bezos is eagerly awaiting your advice on Amazon.com acquisition targets. Farm automation is a great strategic fit with web services and online retailing, right?
Re:The Myth of a Superhuman AI by Danihan on Friday April 28, 2017 @11:53AM (#14220436)
It's a rather straightforward step in controlling the supply chain when you are pushing something like Amazon Fresh.

I suppose they also aren't a hardware manufacturer? Or a logistics company?

Re:The Myth of a Superhuman AI by MarkPNeyer on Wednesday April 26, 2017 @10:13PM (#14208693)
Just how much faith do you have in your politicians?

By using existing political structures, and a mix of rhetoric, they have managed to get a lot more power than a typical person.

Re:The Myth of a Superhuman AI by DubiousPusher on Thursday April 27, 2017 @11:21AM (#14212149)
Nice point. The US presidential election has had me thinking about how a smart AI might decide instead to manipulate humans into it's will with misinformation campaigns. That of course would require an AI of human comparable intelligence.
Re:The Myth of a Superhuman AI by ben_w on Thursday April 27, 2017 @12:39PM (#14212853)
I believe it doesn't necessarily need to outsmart the /average/ human. Consider this scenario:

* Someone makes an AI which scores only 85 on IQ tests, but which can run in real time on common consumer hardware.

* It gets installed on every phone, PC, and tablet.

* Someone, possibly the AI itself if is the type to generate its own goals, sets all instances of the AI the goal of convincing their user of some belief or policy or whatever.

* Everyone with IQ<85 is convinced, nobody with an IQ>85 is convinced.

* 16% of the population believe whatever it is the goal-setting mind wanted them to believe, at marginal cost. An election is swung, a bank suffers a run, a pyramid scheme makes millions, whatever it is.

Re:The Myth of a Superhuman AI by MarkPNeyer on Friday April 28, 2017 @04:06PM (#14222639)
the ability to emit words on the screen gives a human-like intelligence all kinds of abilities

especially if the human-like intelligence doesn't need to pay rent, fear the police, follow laws, sleep, eat ... etc

Re:The Myth of a Superhuman AI by ben_w on Tuesday May 02, 2017 @07:22PM (#14251609)
In the absence of counter examples, it's reasonable to assume a truly human-like intelligence needs as much down-time and sleep as a real human, and that it can be as effectively coerced with the threat of simulated prison if it breaks the rules.

But the point about food and rent is very economically important if they ever get to be cheaper than human labour.

Re:The Myth of a Superhuman AI by crusso on Wednesday April 26, 2017 @10:00PM (#14208639)
Would you imagine that a computer smarter than the smartest human and having the understanding of computer software that probably only a computer would have couldn't conceal what it's doing as it creates trojans and viruses that can give it control over every piece of connected equipment everywhere?
Re:The Myth of a Superhuman AI by Retra on Thursday April 27, 2017 @12:08AM (#14209109)
All of that is moot when you can just turn off the power.
Re:The Myth of a Superhuman AI by pjc50 on Thursday April 27, 2017 @06:25AM (#14210444)
Can you?

The AI, when it becomes popular, is going to be a business-critical system. Potentially even intertwined with life-critical systems like self-driving cars and self-flying planes. If it isn't, then in "hidden malevolent hacker" phase it can just install trojans to make those systems dependent on it.

Petrol production is hazardous to our future. Can you "just turn it off"? Yes; shut down a fairly small number refineries and the system will run dry within a week. CO2 emissions problem solved! It's just that, you know, people were depending on being able to get food delivered by truck.

Obviously the first malevolent AI is going to hide itself behind an offshore opaque-ownership company and hire a good set of PR and lobbying firms. Can you turn off Skynet when it's reported as "critical to national security" in all the news sources?

Re:The Myth of a Superhuman AI by Retra on Thursday April 27, 2017 @07:56PM (#14215859)
So you're supposing that we have honed and selected an AI so wonderfully adept at valuing human needs that we make most human life dependent on it, yet it will spontaneously come to disregard the value of human life? And despite the fact that we would naturally require it to be sufficiently transparent about it's valuations in order to actually ensure we get the results we want, it will also develop this animosity in secret?

That seems a bit contradictory to me. And if not, highly contrived and unlikely.

Re:The Myth of a Superhuman AI by crusso on Thursday April 27, 2017 @10:40PM (#14216527)
"And despite the fact that we would naturally require it to be sufficiently transparent about it's valuations"

That's not necessarily true at all. Let's say we come up with a way to model neurons in silicon like a very complex neural net to the point of emergent consciousness. We might not be able to look into memory location 0xFFA79348 and get the "human value" int to see if it is high enough.

It could very well be that we don't really understand the weighting in the net or the implications of those weights because it's too complicated. Even current neural nets of non-trivial complexity can be impenetrable to evaluate outside of the net itself.

Re:The Myth of a Superhuman AI by Retra on Friday April 28, 2017 @06:50PM (#14223797)
Transparency doesn't require that you be able to read its memory directly, just that it is able to sufficiently justify the decisions that it makes.
Re:The Myth of a Superhuman AI by crusso on Saturday April 29, 2017 @02:19PM (#14227882)
Like we can justify all decisions made by super genius people who are extraordinarily good at concealing their activities when their cognitive processes and abilities on the Internet and with other forms of communication would be beyond our comprehension?

I think that you overestimate our ability to understand what we can create. Even Deep Neural Net researchers consider the neural nets to be a black box that they don't really understand. Further... unlike human beings who are locked into their genetics and their neuronal pathways - an AI will have the instant ability to improve itself. It will be able to rewrite its own software faster than we can comprehend. In the hours from the time the AI would be created until a researcher even might realize what he had created, the AI will effectively have had years or tens of years of contemplation time and self-enhancement time. If the researcher goes to sleep with plans to work with the new AI the next morning, the AI will effectively have hundreds of years of time to plan and improve itself. If it has any kind of Internet access, it will be able to take over systems around the world, possibly parallelizing its own cognitive abilities and possibly backing up its consciousness in case the researcher decided to eventually wipe it.

The genie will be out of the bottle so fast that human beings will almost assuredly be caught flat-footed.

I always shake my head when I see sci-fi shows where the humans (Stargate, Star Trek, etc.) come up against advanced AI opponents. It's only through control of the script and plot contrivances that the humans have a chance. People just won't be able to compare to thinking and self-modifying AI.

https://www.ted.com/talks/sam_harris_can_we_build_ai_without...

Re:The Myth of a Superhuman AI by pjc50 on Friday April 28, 2017 @10:42AM (#14219735)
> AI so wonderfully adept at valuing human needs that we make most human life dependent on it, yet it will spontaneously come to disregard the value of human life?

This is an argument often deployed against "corporations" or "capitalism", both of which aren't quite intelligent but are definitely systems that we're dependent on and capable of disregarding inconvenient lives.

The AI doesn't have to hate humans, it just has to find that they get in the way of its quarterly targets.

Re:The Myth of a Superhuman AI by Klockan on Thursday April 27, 2017 @04:06AM (#14209956)
That wont help, we know how to turn off humans from across the world with the click of a button yet we still haven't managed to create peace on earth.
Re:The Myth of a Superhuman AI by lgas on Thursday April 27, 2017 @03:50AM (#14209893)
If it was successfully concealing its actions from you, what reason would you have to turn off the power?
Re:The Myth of a Superhuman AI by Retra on Thursday April 27, 2017 @07:51PM (#14215829)
If it were successfully concealing its actions, what wrong would it be doing? If all the bad things someone does has no effect on anyone else, then who cares if they do them?
Re:The Myth of a Superhuman AI by crusso on Thursday April 27, 2017 @10:42PM (#14216535)
Because it could be concealing its actions until it controls enough infrastructure or military power to launch an attack or prevent people from being able to shut it down.

What we don't know can hurt us.

Re:The Myth of a Superhuman AI by Retra on Friday April 28, 2017 @06:55PM (#14223825)
It is not 'concealing its actions' if it is taking control of infrastructure and military power.

Just like I'm not 'concealing my actions' by putting a blindfold over your eyes. My action is "putting a blindfold over your eyes", which must be very apparent for the entire action to have any value. Now if I hide that action by putting on an invisible blindfold, then you've got nothing to complain about anyway.

Re:The Myth of a Superhuman AI by crusso on Saturday April 29, 2017 @08:50PM (#14229621)
Why would it be so obvious if it understands enough about strategy to use subterfuge?

When the US government unleashed Stuxnet, did it announce what it was going to do?

Re:The Myth of a Superhuman AI by TeMPOraL on Thursday April 27, 2017 @05:01AM (#14210143)
Batteries exist. And so do small-scale power generators like PV cells, windmills and, well, diesel generators.
Re:The Myth of a Superhuman AI by ben_w on Thursday April 27, 2017 @06:12AM (#14210395)
Counter-examples exist every time any critical infrastructure is hacked: if the systems were truly proven, they wouldn't be hackable.

Proof is hard, good enough gets deployed.

Re:The Myth of a Superhuman AI by szc on Thursday April 27, 2017 @12:48AM (#14209244)
This makes me want to find and watch "Colossus: The Forbin Project" (1970s SCI-FI)
Re:The Myth of a Superhuman AI by epx on Wednesday April 26, 2017 @09:10PM (#14208413)
Yes, but it is noteworthy that most geniuses are shortsighted in other respects. They probably would not survive in prehistory.
Re:The Myth of a Superhuman AI by pacaro on Wednesday April 26, 2017 @10:43PM (#14208806)
It's not clear to me how true this is. There are definitely individuals that exhibit savant skills in one area and mediocre to poor skills in other areas. But there are also true polymaths who can turn their hands to just about anything, I suspect that those people would do well on aggregate in any period of human history
Re:The Myth of a Superhuman AI by obstinate on Wednesday April 26, 2017 @11:27PM (#14208973)
Depends on the style of genius. Napoleon, Genghis Kahn, Alexander the Great . . . they seem to have done pretty well for themselves.
Re:The Myth of a Superhuman AI by wand3r on Wednesday April 26, 2017 @10:24PM (#14208740)
Obviously some did.
Re:The Myth of a Superhuman AI by jacquesm on Wednesday April 26, 2017 @11:03PM (#14208870)
At least long enough to reproduce.
Re:The Myth of a Superhuman AI by babyrainbow on Wednesday April 26, 2017 @11:58PM (#14209074)
>We can measure the speed impulses travel through neurons, and compare that to, say, the speed of electrical impulses through silicon or light through fiber.

This assumes that all the processing that human brain does is by sending signals across the neurons. Which we really don't know. Right?

>We can look at other evolved/biological capabilities, like swimming or flying, and compare them to state-of-the-art artificial analogs..

Do we yet have an airplane yet that can come close to the efficiency of the most clumsiest of the birds?

Re:The Myth of a Superhuman AI by hughes on Thursday April 27, 2017 @12:10AM (#14209116)
> Do we yet have an airplane yet that can come close to the efficiency of the most clumsiest of the birds?

Regardless of efficiency, we have certainly exceeded the range, cargo capacity, top speed, and passenger space of most birds.

Similarly, even if signal propagation in the brain is not understood, we could conceivably beat the brain in other metrics.

Re:The Myth of a Superhuman AI by TeMPOraL on Thursday April 27, 2017 @05:07AM (#14210161)
> Regardless of efficiency, we have certainly exceeded the range, cargo capacity, top speed, and passenger space of most birds.

This is the core point. Our technology may still suck compared to nature, but we've been beating nature consistently since before humans learned to write, because we don't have the same set of constraints that natural biological systems have.

So just like we can make inefficient flying machines that beat nature on most other conceivable metrics, we could presumably build an energy-inefficient but smarter mind at some point.

Re:The Myth of a Superhuman AI by type0 on Thursday April 27, 2017 @08:59AM (#14211091)
I would say the progress that humans have achieved by now was by hacking the Nature, we were able to do this because we are part of the Nature. so in order to produce the AI that would be capable of progress that humans are to do it needs to be a part of Nature. Such wet-ware computers already exist, look up DNA based computers, but those are highly constrained (and their io is terrible). The sort of intelligence we can get to the wet-ware based AI is probably will be better spend on improving our own intelligence by hacking own our brains.

> we could presumably build an energy-inefficient but smarter mind at some point.

So this smarter mind will probably be our own, but that would also be achieved by some sort of artificial means.

Re:The Myth of a Superhuman AI by TeMPOraL on Thursday April 27, 2017 @10:19AM (#14211618)
Saying that "progress that humans have achieved by now was by hacking the Nature" implies that planes and computers are "hacking Nature" too, so this doesn't preclude a silicon brain, nor does it suggest the AI will have to be biology-based. Planes aren't biology based; in fact, we only cracked powered flight after we stopped trying to mimic birds.

> So this smarter mind will probably be our own

It's plausible for me too, but not because we can't do stuff outside what evolution did - just because it's usually easier to hack an existing system than to build a new one from scratch.

Re:The Myth of a Superhuman AI by type0 on Friday April 28, 2017 @08:21AM (#14218792)
> hacking the Nature" implies that planes and computers are "hacking Nature" too

Sure it does, because physical laws are a fundamental part of Nature

Re:The Myth of a Superhuman AI by TeMPOraL on Friday April 28, 2017 @01:14PM (#14221225)
Nobody tries to build an AI that breaks laws of physics by virtue of existing :). If we're extending the term "Nature" to mean all reality, then silicon brains are a part of nature too.
Re:The Myth of a Superhuman AI by babyrainbow on Thursday April 27, 2017 @07:58AM (#14210787)
>we could conceivably beat the brain in other metrics.

Sure, the very first calculators beat brain in some metrics. But we are not talking about those metrics here.

Re:The Myth of a Superhuman AI by _greim_ on Thursday April 27, 2017 @11:58AM (#14212474)
> This assumes that all the processing that human brain does is by sending signals across the neurons. Which we really don't know. Right?

It doesn't need to assume all, just some non-trivial amount. I don't know the ratio of inter-neuron to intra-neuron processing in brains, or if such a metric even exists. But it seems theoretically possible at least to measure the computing power of a neuron in isolation, and see if artificial analogs exist (or could be built) that exceed that by some margin. Ultimately we're just looking for avenues of evidence to explore.

Re:The Myth of a Superhuman AI by _greim_ on Thursday April 27, 2017 @11:36AM (#14212275)
> Do we yet have an airplane yet that can come close to the efficiency of the most clumsiest of the birds?

The author makes a good point about intelligence not being one-dimensional, and I think the same thing holds for flying ability. Efficiency is one dimension, but you also have speed, range and so forth.

Re:The Myth of a Superhuman AI by martin-adams on Thursday April 27, 2017 @02:43AM (#14209660)
Looks like the vaginal canal is no longer a limiting factor. C-Sections are having a measurable impact on this.

http://www.bbc.co.uk/news/science-environment-38210837

Re:The Myth of a Superhuman AI by scythe on Thursday April 27, 2017 @03:21AM (#14209801)
>We can find the maximum head-size that fits through a vaginal canal, or the maximum metabolic rate a human body could support, and try to determine if these factors imposed any limitations on intelligence during human evolution.

Head sizes have been larger in human history and some human relatives with larger brains died out. Energy consumption on the other hand is a limiting factor for every computational device and energy efficiency tends to be a key category where Nature still wins. In particular, the liver and enzymes of various plants and microbes can perform chemical reactions in water at ambient temperature that we can't do at all; resilin is still a more efficient elastic material than any synthetic elastomer; artificial piezoelectric muscles have less than a tenth the energy efficiency of real ones, and of course lots of animals are able to run around in polar and desert regions we still can't traverse because of the fuel and material costs etc.

One particularly revealing example is to calculate the ratio between:

* the performance per watt of the most efficient supercomputer (7 GFlops/watt) vs the human brain (38 petaflops / 20 watts = 1.9 petaflops per watt)

* the performance per watt of the human brain vs the Landauer limit at body temperature (don't remember)

Re:The Myth of a Superhuman AI by moultano on Thursday April 27, 2017 @04:21AM (#14210010)
>* the performance per watt of the most efficient supercomputer (7 GFlops/watt) vs the human brain (38 petaflops / 20 watts = 1.9 petaflops per watt)

Encouraging, but AI wouldn't be constrained to an energy budget similar to a human. At the rates you describe, beating a human would take the output of only a single wind turbine. https://en.m.wikipedia.org/wiki/Orders_of_magnitude_(power)

Re:The Myth of a Superhuman AI by FeepingCreature on Thursday April 27, 2017 @04:07AM (#14209958)
Yeah but ... human beings are fuelled via stomachs. Computers are fuelled via turbines built into gigantic dams. Or nuclear reactors. Or wind turbines. Or...
Re:The Myth of a Superhuman AI by TeMPOraL on Thursday April 27, 2017 @05:04AM (#14210155)
It's a general principle of contemporary technology that we lose with nature on efficiency, but compensate for that with sheer scale of our solutions. Birds are much more energy-efficient than planes, but then again, birds can't fly supersonic and don't move around tons of cargo.
Re:The Myth of a Superhuman AI by sullyj3 on Thursday April 27, 2017 @11:46AM (#14212356)
>> what evidence do we have that the limit is not us?

This is just such manifestly wrongheaded reasoning as to be almost laughable.

I think there's a substantially better argument against this notion than to actually try to find evidence against the claim. I prefer it because it reveals the total wrong-headedness of this style of reasoning. The argument is to turn it around and say "what evidence do we have that the limit is us?" A human level of intelligence seems like an incredibly and oddly specific level to be the maximum permissible by physics. And oddly specific claims need to be treated with extreme skepticism, because they carry high entropy, in violation of Occam's razor.

If you want to know what x equals, you don't pick a number, say, 2, assume x=2, and ask people to provide you with reasons why it shouldn't be 2. There's an infinity of numbers, and the odds are just overwhelmingly against x happening to be 2. You start with the assumption that x could be literally any of the infinity of numbers, and start looking for evidence which narrows it down. More concretely, if you want to know the physical limit to intelligence, you start with the assumption that it could be anything, constrained by the evidence that's currently available. In this case, the evidence is that human intelligence provides a lower bound for the maximum physically allowable intelligence.

Positing that our intelligence is the maximum possible becomes even more suspect when you consider the process by which our intelligence came about - evolution.

Firstly, evolution is a process which tends towards reproductive fitness, not necessarily towards intelligence. Intelligence is selected for to the extent that it makes something more likely to reproduce, and no more, and it probably isn't the case that more smarts universally leads to more reproduction. In fact, most modern research suggests the opposite, with people with higher IQs having less sex.

Secondly, we know that natural selection gets stuck in local optima. If your species is on top of a 10 smart-points hill, and in order to get to get to the 1000 smart-points hill over there your species has to mutate in a direction that makes it stupider before it gets smarter, your species is going to stay on the 10 smart-points hill. This is because individuals that mutate stupider in the direction of the 1000-point hill will be selected against.

Thirdly, natural selection just isn't a very powerful optimization process. It works by random mutation, and it takes a lifetime to make a minuscule change which may or may not be in the right direction. Even if natural selection was solely optimizing for intelligence, and it could somehow avoid local optima, there would be no particular reason to believe that the world had existed long enough for the smartest possible organism to evolve.

Fourthly, as _greim_ touches upon, evolution has a very limited medium to work with. All it can do is change the sequence of DNA base pairs, and produce inefficient meat machines that run on respiration. There are all sorts of complex arrangements of matter which might be intelligent, and biological ones are only a tiny subset of those possible arrangements. The odds of the smartest system physically possible residing in that little biological subset are tiny to begin with, and only get smaller as you consider the more direct arguments against biological systems mentioned above, like sluggish neural transmissions, etc.

Re:The Myth of a Superhuman AI by _greim_ on Thursday April 27, 2017 @12:08PM (#14212579)
Exactly. From a skeptical POV, it's much harder to argue something can't be the case than it is to argue something could be the case. Especially for a complex and multi-faceted concept of intelligence levels, which the author admits isn't one-dimensional.