News for hackers. Stuff that matters.
Re:Where will artificial general intelligence come from? by CuriouslyC on Saturday September 02, 2017 @09:35PM (#15159219)
I don't know that "maximize descendants of self" is necessarily right though. It seems like a better statement might be "maximize the development of complexity in the universe". Just as an example, lots of people choose to forgo having children to focus on contributing to the universe in other ways (myself included). This isn't just a self-centered drive for fame/wealth/etc either, as many people pursue their quests in poverty/obscurity, and some even choose anonymity.
Re:Where will artificial general intelligence come from? by mirimir on Saturday September 02, 2017 @11:30PM (#15159534)
Well, for biological organisms, it's all about reproductive success. I mean, what exits today reflects what managed to reproduce, and how well. Overall, that has created lots of complexity. But that's just because there are so many niches and ways to be successful in them.

What you say about people reflects cooperative behavior that drives reproductive success for shared gene complexes.

Re:Where will artificial general intelligence come from? by TheOtherHobbes on Sunday September 03, 2017 @07:17AM (#15160852)
It took nature four billion years to invent humans, who are actually - if we're honest - pretty terrible as an example of workable AGI.

In fact what nature invented was a persistent colony organism with external memory.

Wild solo humans are only a little smarter than wolves individually, but being able to share and externalise invention and learning created a massive advantage.

Humans are successful because although only a tiny minority of individuals are any good at invention, the fact that information persists and is shared means the entire population benefits.

The problem for AI is modelling the learning and invention process. Classifiers and recognisers are getting better, but they're not really learning in the human sense, which is a combination of abstraction, mimicry, and occasional invention.

IMO there's no chance of AGI developing until there's a persistent, transferable, abstracted model generated as an output from classifier systems and other learning machines which is a symbolic - not just a statistical - summary of the learning.

Re:Where will artificial general intelligence come from? by visarga on Tuesday September 05, 2017 @12:11AM (#15172461)
Transfer learning is a thing (one NN learns from another or multiple NNs), also, large ontologies representing billions of facts.
Re:Where will artificial general intelligence come from? by red75prime on Monday September 04, 2017 @01:30AM (#15165922)
> until there's a persistent, transferable, abstracted model [...]

It can be compressed to "until AIs can talk".

Re:Where will artificial general intelligence come from? by mirimir on Monday September 04, 2017 @03:30AM (#15166400)
... to other AIs.
Re:Where will artificial general intelligence come from? by red75prime on Monday September 04, 2017 @04:09AM (#15166548)
or "... to itself"
Re:Where will artificial general intelligence come from? by visarga on Tuesday September 05, 2017 @12:08AM (#15172451)
> for biological organisms, it's all about reproductive success

Another way of putting it - the source of meaning is life, or death (prolonging life, avoiding death as much as possible). Reproduction is just the start of life. From this game of life and death come reward signals that teach us how to act in the world (our values).

Re:Where will artificial general intelligence come from? by mannykannot on Sunday September 03, 2017 @01:02PM (#15162500)
There is no guarantee that pursuing complexity as a goal in itself will lead to intelligence. The one thing going for mannigfaltig's proposal is that it has been known to work, though very inefficiently, and we don't have enough examples to estimate the yield. One might suggest that having the right definition of complexity would produce the desired result, but coming up with that definition takes us right back to CuriouslyC's point.
Re:Where will artificial general intelligence come from? by visarga on Tuesday September 05, 2017 @12:17AM (#15172485)
I give you a simple definition: maximize diversity (differentiation) and integration. They are opposites, to a degree - so there is a tradeoff and maximum at the middle in both diversity and integration. This idea comes from the Integrated Information Theory of Consciousness (Giulio Tononi, Christoph Koch).

In a neural net we do just that - maximize diversity by splitting the signal over many neurons, each with different weights, computing different things. Integration is maximized by the mixing together of signals from other neurons and training them together with a common loss function.

Even the internet as a medium requires diversity and integration to be successful. For example, net neutrality is related to diversity. Integration is related to national firewalls, copyright barriers, filter bubbling effect (where one sees only content from parts of the internet they agree with), walled gardens (like the app stores), and other things that cut the connection between people.

You can apply diversity and integration to other fields as well, for example, in politics/governance. We can compare a federal system (more diversity) with a centrally planned system (less diversity) and see the effects. With integration - we can compare free trade with regulated trade. The same principles apply to free speech - where diversity and integration are basically promised by the constitution.

Re:Where will artificial general intelligence come from? by mannykannot on Tuesday September 05, 2017 @08:06AM (#15174346)
Well, maybe, but it looks very speculative to me. I think anything deserving the label 'definition' would have to be much more definite than that.