News for hackers. Stuff that matters.
Re:Measuring abstract reasoning in neural networks by foxes on Sunday July 15, 2018 @06:28AM (#17534631)
Frankly, I doubt that neural networks can "reason" in an abstract way. Correct me if I am wrong but it looks like you got what you ordinarily except from a neural network. The network was successfully trained to pick out certain progressions (or properties) in the training images. It's not doing any reasoning at all - just the usual thing neural networks do.
Re:Measuring abstract reasoning in neural networks by stared on Sunday July 15, 2018 @07:58AM (#17534856)
Abstraction is looking at some properties, while abstracting others (removing, ignoring). Even simple artificial neural networks for computer vision can do so - e.g. ignoring noise, small rotations, reflections or the background.

If, or when, it gets to human-level (for a given task) is another question. But saying that computers cannot learn how to abstract data is demonstrably false.

Vide https://distill.pub/2017/feature-visualization/ for internal representations.

Re:Measuring abstract reasoning in neural networks by guntars on Sunday July 15, 2018 @11:39AM (#17535672)
I’d say neural networks abstract over successive layers until the answer becomes self evident. That’s not the same as reasoning though.
Re:Measuring abstract reasoning in neural networks by stared on Sunday July 15, 2018 @12:12PM (#17535814)
What do you exactly mean by "reasoning"?
Re:Measuring abstract reasoning in neural networks by ovi256 on Tuesday July 17, 2018 @04:07PM (#17552823)
Reasoning is whatever is left after you take away everything neural networks do. Obviously!
Re:Measuring abstract reasoning in neural networks by eivarv on Sunday July 15, 2018 @07:26AM (#17534760)
What is reasoning, really?

Does the internal operations of "artificial" systems necessarily differ the (automatic) processes of our own mind?

And how do we know that we're _really_ reasoning?

I don't suffer under some illusion that current machine learning algorithms have reached AGI, consciousness or sentience – but we need to define these terms before arguing about them.

It seems to me that there's a general problem of definition when people talk about what systems can and can't do - and I think it all might just be a convoluted form of an "Appeal to nature" [0] in the case of these endless, unoriginal criticisms of current AI-efforts.

[0]: https://en.wikipedia.org/wiki/Appeal_to_nature

Re:Measuring abstract reasoning in neural networks by foxes on Sunday July 15, 2018 @08:21AM (#17534930)
I think they roughly define what reasoning is. Deducing something from abstract information.

I don't think they have really captured that with this work. They generated some data according to some rules and fed it to a recurrent neural network, which is meant to be good at this. It seems pretty standard. I don't think it gives much insight to how "reasoning" works, or how neural networks work.

These things were originally inspired as a crude approximation to how a real brain might work. However a real brain probably has far more interconnections and recurrence. Should I be surprised if it can capture some of the real behavior?

Re:Measuring abstract reasoning in neural networks by bhouston on Sunday July 15, 2018 @12:06PM (#17535792)
> I think they roughly define what reasoning is. Deducing something from abstract information.

Reasoning is not prediction learned by seeing things happen before exactly in the same way. Moving a hand to catch a ball is not reasoning, it is recognition and prediction based on doing it a bunch of times.

Reasoning to know that 4 comes after 3 after seeing that happen a lot is not reasoning, it is prediction again, and even easier than predicting the motion of a ball.

Reasoning involves finding a pattern that you haven't seen before a thousand times but you use the elements you know and look to see how they combine to fit the existing problem. Reasoning by its nature is the ability to succeed in a novel situation that requires logic and exploration in search of a problem. Reasoning is successive cycles of experimental prediction with recognition and running an evaluator on top to see which way to explore. (I think this can be coded probably in the near term, but it is more than just a single NN.)

That said, if you provide enough situations to a NN it may be able to solve a lot of "reasoning" situations via recognition and prediction, but it will sort of be stupid if anything falls out of its training data -- similar to how NNs can be fooled completely by slightly modified pictures of animals.

Re:Measuring abstract reasoning in neural networks by ArtWomb on Sunday July 15, 2018 @08:49AM (#17535018)
>>> I doubt that neural networks can "reason" in an abstract way

Unless there is of course some underlying "structure" to our phenomenological reality that affords us these insights ;)

I'd take a look at the recent CV paper on "Taskonomy" from the Stanford Graphics Lab. Instead of semantic labeling of training data by human operators. We can begin to apply learning to high resolution sensor data. Such as RGBA, motion and depth images. And uncover hidden emergent relationships inherent in their geometric and physical properties. Since these "laws" are universal. They can essentially be transferred to myriad other tasks in vision.

http://taskonomy.stanford.edu/

It is precisely this type of learning that DeepMind seeks to quantify with its tool. No one can say precisely why we as humans can look at a thing for the first time and comprehend its "thingness": its utility, its purpose, its meaning and social context. But I believe we are far closer than we imagine to robust meta-learning for intelligent machines on a grand scale!

Re:Measuring abstract reasoning in neural networks by thomasfedb on Sunday July 15, 2018 @06:52AM (#17534678)
The big neural network I keep behind my eyes feels otherwise.
Re:Measuring abstract reasoning in neural networks by olalonde on Sunday July 15, 2018 @07:17AM (#17534734)
That's not a very convincing argument given that modern ANNs are only vaguely inspired by the biological neural network behind your eyes.
Re:Measuring abstract reasoning in neural networks by thomasfedb on Sunday July 15, 2018 @12:00PM (#17535760)
I think the ultimately important similarity is that of a complex system that consists of (relatively) simple repeating units.
Re:Measuring abstract reasoning in neural networks by dimensionality on Sunday July 15, 2018 @09:58AM (#17535254)
I'd say that semantic embeddings already capture abstract conceptual relations, what remains is to figure out how to extract and relate this information unsupervised.