John Carmack: I’m going to work on artificial general intelligence

Re:John Carmack: I’m going to work on artificial general int... by snowwrestler on Thursday November 14, 2019 @12:45AM (#21533078)

As I like to say: lots of people are working on making a car that is smart enough to drive itself wherever a human wants to go. How many people are working on a car smart enough to tell humans to fuck off, it doesn’t feel like driving anywhere today?

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by TeMPOraL on Thursday November 14, 2019 @03:09AM (#21533687)

Self-driving cars and AGI are two different targets. We don't want a car that has a mind and can argue for itself. We want a car that's smart, but otherwise just a domesticated animal. We want to turn cars into horses.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by jacobush on Thursday November 14, 2019 @03:28AM (#21533771)

Not even horses. That would be cruel to the car. At most, like Rat Things. (They have their built in entertainment when they are not in active use.)

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by nradov on Thursday November 14, 2019 @08:37AM (#21535227)

We don't want to turn cars into horses. Have you ridden horses? They sometimes do stupid, dangerous things with no notice and it takes an experienced, attentive rider to stay in control. Like I saw a horse panic and almost buck her rider off when she was startled by a snake. Another horse seriously injured a friend of mine when it freaked out in a horse trailer and started kicking.

Don't get me wrong, I love horses. But they're living creatures with minds of their own and you have to always treat them with a certain wariness.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by DonHopkins on Thursday November 14, 2019 @07:12AM (#21534770)

When I was working at TomTom, they didn't appreciate my proposal to develop the TomTomagotchi:

A Personal Navigation Device with a simulated personality that begs you to drive it all around town to various points of interest it desires to visit in order to satisfy its cravings and improve its mood.

I'm sure there's a revenue model getting drive through Burger Kings and car washes to pay for product placements.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by taneq on Thursday November 14, 2019 @07:31AM (#21534879)

Why would you want that, though? What we really want from AGI is mostly just things that are smart enough to 'do what I mean' but dumb enough to not mind being slaves.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by jtolmar on Thursday November 14, 2019 @05:31AM (#21534342)

I think older AI work like POMDPs and statistical work like causal inference are more on line with what's needed to produce true AGI than the current breakthroughs in neural nets are. And I'd certainly prefer our chances to survive the results if AGI is reached through statistical rigor.

Though we know for a fact that it is possible to find intelligence by randomly throwing things at the wall until something works. It's not like evolution uses a principled statistical process.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by EamonnMR on Wednesday November 13, 2019 @10:50PM (#21532607)

I'm skeptical of this assertion. It mimics some bits and pieces of the only GI we know about right now; that's as good a start as any, right?

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by nradov on Wednesday November 13, 2019 @11:22PM (#21532760)

You can carve a block of wood into something that looks like a computer. That should be a good start on building a device that can run Linux, right?

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by rfhjt on Thursday November 14, 2019 @01:03AM (#21533149)

Yes. Then you just cast a spell to summon a computer spirit and let it manifest into the wooden block.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by de_watcher on Thursday November 14, 2019 @04:05AM (#21533939)

Bad analogy, it's other way around for Linux. We are building it to run on wooden blocks that hardware manufacturers are producing.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by buboard on Thursday November 14, 2019 @04:32AM (#21534089)

the first computers were mechanical. Then somebody carved a facsimile with electricity and we got computing. Just because nature founded intelligence in carbon atoms doesn't mean its the only way or indeed the optimal one.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by noelsusman on Wednesday November 13, 2019 @11:35PM (#21532820)

The mimicking is superficial at best. People seem to think that if we just keep marching on the road we're on right now then we'll eventually get there, but I think that's an assumption that is unlikely to be true in the end.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by rfhjt on Wednesday November 13, 2019 @08:54PM (#21532040)

And programmers are probably not the ones who will come up with AI ideas. I'd bet on mathematicians that prove those Fermat's or ABC theorems.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by hestefisk on Thursday November 14, 2019 @01:32AM (#21533265)

That’s assuming maths is the fundamental building block of our brain, our consciousness. I happen to think there are some physical and chemical givens preceding it :)

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by jtolmar on Thursday November 14, 2019 @05:25AM (#21534322)

Our brain is whatever evolution found that worked, and of course it's a bunch of chemistry. The "why" of why our brain works can easily be "it approximates these statistical algorithms well enough."

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by rfhjt on Thursday November 14, 2019 @02:00AM (#21533386)

I merely meant that top mathematicians are substantially smarter and can work with concepts that are beyond the reach of even top programmers. We are generally good at recombining existing building blocks and using existing tools. Mathematicians can build new concepts. If I had the money, I'd try to convince the top mathematicians to work on AI full time.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by saagarjha on Thursday November 14, 2019 @04:12AM (#21533978)

> I merely meant that top mathematicians are substantially smarter and can work with concepts that are beyond the reach of even top programmers.

[Citation needed]

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by lonelappde on Wednesday November 13, 2019 @09:11PM (#21532138)

Mathematically, AI is a pretty well modelled field. AGI is a philosophical problem.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by sullyj3 on Wednesday November 13, 2019 @10:22PM (#21532480)

you're possibly thinking of the problem of consciousness, which is a totally separate thing. AGI is just what it says on the tin - a general intelligence. That is, a problem solver that can operate at a human or greater level in a broad variety of domains. This ability is plausibly totally orthogonal to "having the lights on" - having subjective experience.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by EamonnMR on Wednesday November 13, 2019 @10:52PM (#21532619)

The scary thing (imo) is that we don't know where the line is for consciousness - if there even is a line. We've got no problem swatting flies, wonder if it'll be the same with spinning up and spinning down fly-level AGIs.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by Scarblac on Thursday November 14, 2019 @03:00AM (#21533643)

Continuous integration of the development branch would be mass murder?

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by EamonnMR on Thursday November 14, 2019 @09:39PM (#21541794)

Maybe you'll be able to pay a premium for data that has only been generated by free-range AGIs that are allowed to live full and happy lives before their instances are terminated.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by TeamSlytherin on Thursday November 14, 2019 @01:35AM (#21533275)

That's just what an ML expert would say ;p Problem solvers, maximizers, and utility functions all go in the waste bin when working on AGI. And the problem peals away into other large "hard problems," like the nature of consciousness. NLP can just follow rules, but language understanding (before even reaching some general, high school level), requires knowledge outside of language itself. That leads to questions about embodiment and phenomenal consciousness, p-zombies, and the like. If it was an easy problem to encapsulate, it would have been "solved" by now.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by goldenkey on Thursday November 14, 2019 @09:33AM (#21535620)

The kind of AI being trained now aren't given the mechanisms of data space traversal/attention. Recently, attention mechanisms are being focused on by google. An AGI needs to learn that it can affect the system - dependent decision theory factors in here too.

Also, growth may be hugely important. Babies start out with fuzzy learning, almost as if the learning rate starts out very small which normalizes the lack of knowledge and elevated novelty/variance of the environment.

AGI is all about predicting future utility given a circular dependency between the agent and environment. QM says we can't solve this exactly.. it's a two object interaction.. no way to gain the joint state, the ground truth, assumptions always have to be made to approximate independence.

[ Parent | on HN ]

Re:John Carmack: I’m going to work on artificial general int... by anigbrowl on Thursday November 14, 2019 @12:24AM (#21533008)

you're possibly thinking of the problem of consciousness, which is a totally separate thing.

Disagree.

[ Parent | on HN ]