News for hackers. Stuff that matters.

A comment on The Great A.I. Awakening. Parent comment

Re:The Great A.I. Awakening by zer0gravity on Friday December 16, 2016 @02:32AM (#13191709)
The tricky part is to prevent AGI from developing goals of its own. You want it omnipresent and allknowing but dormant, and only react to inputs from the user.

But such thing cannot be tamed. As the AGI is democratized, it's bound to happen that someone somewhere will make it evolve goals.

The future of the human kind will be decided in a great measure by what kind of goals such an AGI will set first.

[ Parent | on HN ]
Re:The Great A.I. Awakening by drabiega on Friday December 16, 2016 @01:32PM (#13195509)
I'm pretty sure you can't get to AGI in the first place without it being to develop it's own goals. Even if you want a straight question answering machine, it's going to have to be able to form it's own sub-goals in order for it to be able to answer your question. Otherwise it's just following a mechanistic process of question answering and a normal computer we have now can do that.
[ Parent | on HN ]