Re:AI, Deep Learning, and Machine Learning: A Primer [video]
by autokad on Saturday June 11, 2016 @11:44AM
(#11883842)
We will be closer to cracking neural nets and are closer to the singularity when we can train a net on two completely different tasks and each task can make other predictions subsequently better. IE: train / test it on spam / ~ spam emails, then train the same net with twitter data male / female.
[ Parent
| on HN ]
Re:AI, Deep Learning, and Machine Learning: A Primer [video]
by nl on Saturday June 11, 2016 @01:02PM
(#11884202)
You can do this now(?!)
In fact something as simple as naive Bayes will work reasonably well for that.
I'm not sure if you are aware, but in (say) image classification it's pretty common to take a pre-trained net, lock the values except for the last layer, and then retrain that for a new classification task. You can even drop the last layer entirely and use a SVM and get entirely adequate results in many domains.
Here's an example using VGG and Keras: http://blog.keras.io/building-powerful-image-classification-...
And here a similar thing for Inception and TensorFlow: https://www.tensorflow.org/versions/r0.8/how_tos/image_retra...
Re:AI, Deep Learning, and Machine Learning: A Primer [video]
by dharma1 on Saturday June 11, 2016 @03:10PM
(#11884836)
Transfer learning at the moment works within one domain (say images), because the low level shapes are still similar, but not between different domains of data
Re:AI, Deep Learning, and Machine Learning: A Primer [video]
by nl on Sunday June 12, 2016 @02:16AM
(#11886897)
Sure, that's what I was pointing out.
However: Zero-Shot Learning Through Cross-Modal Transfer http://arxiv.org/abs/1301.3666
Re:AI, Deep Learning, and Machine Learning: A Primer [video]
by gavanwoolery on Saturday June 11, 2016 @11:48AM
(#11883860)
I agree - this would be general intelligence. You can adjust weights for one problem very specifically to some degree of success, but having that affect a different slightly related problem (and even being able to distinguish between two differing problems) is going to require some rethinking, or enormous compute power exponentially beyond what we have now.