News for hackers. Stuff that matters.
[dead]
Re:John Carmack: I’m going to work on artificial general int... by K0SM0S on Wednesday November 13, 2019 @07:12PM (#21531311)
I'll say this: I'd prefer if the brightest minds approached the matter from the "AI safety" angle (a sub field concerned with building not just AI but "safe" AI, ie that we can control or understand in a practical manner).

Because that's really where the line of human history will be drawn if AGI and above becomes real. AI safety, how advanced we are in it, will directly map to civilization's progress or endangerment as a result of AI.

Edit: this is already true with regards to "psychological safety" from undue influence or outright manipulation with motive (usually financial) by current "ANI" algorithms (newsfeeds, "recommendations", ads, etc). It's a real topic that reduces to human psychological freedom, freewill. It's a BIG topic.

Re:John Carmack: I’m going to work on artificial general int... by zelly on Wednesday November 13, 2019 @07:21PM (#21531372)
It would be easier to take the AI doomsayers' seriously if we were remotely close to AGI. For now it's treated the same way as some guy in a cape in Central Park trying to summon Satan. No one cares because everyone knows it's basically impossible.
Re:John Carmack: I’m going to work on artificial general int... by Bizarro on Thursday November 14, 2019 @12:13AM (#21532963)
Stop staying up late to watch DUST on Youtube.
Re:John Carmack: I’m going to work on artificial general int... by dang on Thursday November 14, 2019 @12:39AM (#21533057)
Please don't respond to a bad comment by breaking the site guidelines yourself. That only makes the thread even worse.

https://news.ycombinator.com/newsguidelines.html

Re:John Carmack: I’m going to work on artificial general int... by asadlionpk on Wednesday November 13, 2019 @06:51PM (#21531153)
I think the real naive are the people who are doing it as a day job.
Re:John Carmack: I’m going to work on artificial general int... by popup21 on Wednesday November 13, 2019 @07:32PM (#21531467)
Oh those are some spicy peppers!
Re:John Carmack: I’m going to work on artificial general int... by randomidiot666 on Wednesday November 13, 2019 @07:01PM (#21531230)
He might as well casually work on Faster Than Light travel, or a Grand Unified Theory.
Re:John Carmack: I’m going to work on artificial general int... by whamlastxmas on Wednesday November 13, 2019 @07:04PM (#21531250)
What is your source for saying AGI will probably wipe out humanity? How could we ever even attempt to guess at the motivations of something we can barely comprehend and doesn't even exist yet?
Re:John Carmack: I’m going to work on artificial general int... by goatlover on Wednesday November 13, 2019 @08:47PM (#21532001)
The main concern is not that it's like Skynet and wishes us harm, but that it does things harmful to us because the means to accomplish the AI's goals are at odds with human values, which was unanticipated by the human creators, since the AGI is coming up with its own solutions. And the AGI doesn't have the same values as humans, so it doesn't care if its solutions are harmful.
Re:John Carmack: I’m going to work on artificial general int... by whamlastxmas on Thursday November 14, 2019 @05:27PM (#21540182)
I guess the risk seems more real if it's a question of "does it share human values". Which is possibly not a one in a million chance it doesn't - it could be a 50/50 chance or worse.
Re:John Carmack: I’m going to work on artificial general int... by AnimalMuppet on Wednesday November 13, 2019 @07:22PM (#21531382)
> and probably wipe out humanity.

Probably? I do not think that word means what you think it means... or else I don't think the balance of probability lies where you think it does.

Re:John Carmack: I’m going to work on artificial general int... by ageofwant on Wednesday November 13, 2019 @09:34PM (#21532278)
You are saying "probably wipe out humanity" is a bad thing ?

I know of several million species that would strongly disagree. Especially if AGIv1 decides to tune the genetics of say most mammals to append 'sapient' to the end of their species name.

Perhaps more constructively consider that AGI is simply the next iteration of 'humanity', yea sure the old versions are redundant anarchisms and apart from some living reserve specimens functionally extinct, but nobody cares as you can sim one up at almost no cost.

Re:John Carmack: I’m going to work on artificial general int... by Bizarro on Thursday November 14, 2019 @12:15AM (#21532973)
You know of 0 species that would strongly disagree, because those several million species don't have the capacity to agree or disagree on whether "wiping out humanity is a bad thing". And you don't speak for them, no matter how much caring about the planet you think you're doing.
Re:John Carmack: I’m going to work on artificial general int... by ageofwant on Thursday November 14, 2019 @01:24AM (#21533233)
I absolutely speak for them, who else will ? Clearly not people like you. I have the capacity to speak for them and so I do. And I will be the only judge about how much "caring" I do or don't do.
Re:John Carmack: I’m going to work on artificial general int... by bronz on Wednesday November 13, 2019 @11:29PM (#21532789)
AGI is not the next iteration of humanity because it will not resemble humanity in any way besides being sentient in some capacity. you will feel quite silly if you get to see it in your lifetime.