News for hackers. Stuff that matters.
Re:Should AI Be Open? by mindcrime on Thursday December 17, 2015 @05:13PM (#10754975)
> Now that's more depressing than global annihilation.

Fair point. But I honestly wonder if it's not true, or close to true. I mean, people have been talking about the "end of science" for a while now, even though we know we're not quite literally at "the end". But let's say that we unify relativity / gravity / QM in the next 100 years or so, and identify the exact nature of dark energy / dark matter. Presumably that would represent knowing close to everything about the physical world that its possible to know. And if we can discover that, it does lead you to wonder "what else would more intelligence represent"?

Of course, maybe we're WAY more than 100 years away from those things. Or maybe we'll never get there. Or maybe if we do, it doesn't mean anything vis-a-vis the limits of intelligence. I'm just thinking out loud here, this isn't an argument that I've put a lot of time into developing...

Re:Should AI Be Open? by Kutta on Thursday December 17, 2015 @05:29PM (#10755068)
> would represent knowing close to everything about the physical world that its possible to know.

That's a severe misunderstanding of what it means to have a unified physical theory. The current standard model of physics allows us to theoretically predict the evolution of physical systems with an insanely high precision. A precision so great that there wouldn't be any meaningful error simulating macroscopic objects like human brains, given sufficient computing power.

But we still have massive holes in our understanding of many things, including human biology or neurology. We don't have enough computing power to precisely simulate, but even if we had that power, it wouldn't necessarily let us understand anything. Elementary particles and humans are on hugely different scales. Observing a simulated human would be easier than observing a human simulated by physics itself, but it wouldn't just magically make everything clear.

Having a TOE in physics brings us very little relative benefit compared to the Standard Model, when it comes to understanding biology, materials science, geology, psychology, computer science, etc.

Re:Should AI Be Open? by mindcrime on Thursday December 17, 2015 @05:39PM (#10755135)
That's a severe misunderstanding of what it means to have a unified physical theory. The current standard model of physics allows us to theoretically predict the evolution of physical systems with an insanely high precision. A precision so great that there wouldn't be any meaningful error simulating macroscopic objects like human brains, given sufficient computing power.

Sure, like I said, I'm just thinking out loud here. Obviously TOE in and of itself doesn't automatically translate into full knowledge of everything in practice. But in principle, it would given sufficient computing power, allow us to simulate anything, which I think would yield additional understanding. But here's the thing, and where this all ties back together: sufficient computing resources may not be possible, even in principle, to allow use of that TOE to do $X. But an upper bound on the amount of computing resources should also reflect something of an upper bound on what our hypothetical AI can do as well.

Or to put it all slightly differently.. if we had a TOE, we'd have shown, at least, that humans are smart enough to develop a TOE. Which I think at least raises the issue of "how much smarter can a machine be, or what would it mean for a machine to be much smarter than that?"

Note to that I'm not necessarily arguing for this position. It's more of a thought experiment or discussion point than something I'm firmly convinced of.

Re:Should AI Be Open? by lmm on Friday December 18, 2015 @06:01AM (#10757850)
Look at how long it's taken us to develop theories or technologies even after we had everything we needed to make them possible. The ancient Greeks had steam engines, but it took us millennia to start using them seriously. The concept of the engineering tolerance makes industry thousands of times more efficient; it could have been invented any time since the 16th century, but it wasn't. The checklist has been known for decades to reduce errors across approximately all disciplines, but it still faces huge barriers to adoption. Evidence-based medicine has been the obviously correct approach since the invention of the scientific method but it's still facing struggles. Even in science, we're still arguing about the interpretation of basic quantum mechanics 100 years after the relevant experiments.