News for hackers. Stuff that matters.
Re:Is There a Smarter Path to Artificial Intelligence? Some ... by FrozenVoid on Thursday June 21, 2018 @05:41AM (#17363488)
Lets rename "Deep learning" to "Statistical Compression". Its essentially distilled data from a dataset, limited by size of the neural network. There isn't anything "deep" there, the goal of NN is always towards overfitting the data.
Re:Is There a Smarter Path to Artificial Intelligence? Some ... by dschuetz on Thursday June 21, 2018 @06:07AM (#17363590)
That approach didn't work for "cyber", "quantum" or similar buzzwords. Calling something by its actual meaning isn't easy to sell. Hell, even "hacking" still has the connotation of some criminal activity, although it is widely known that the process of hacking in itself cannot be classified as benign or malign! But it doesn't matter. What matters is what public thinks of it hearing the buzzword. "Deep learning" is the same thing: "I have no idea what it is, but you know what I mean right?"
Re:Is There a Smarter Path to Artificial Intelligence? Some ... by IshKebab on Thursday June 21, 2018 @07:00AM (#17363859)
There is something deep there - the neural networks are deep. They have lots of layers. It's in contrast to shallow neural networks.

It doesn't mean "deep and meaningful".

Re:Is There a Smarter Path to Artificial Intelligence? Some ... by gaius on Thursday June 21, 2018 @08:06AM (#17364324)
It doesn't mean "deep and meaningful".

It would not be nearly as well funded were it not for this misconception on the part of budget holders, and everyone involved in ML knows it.

Re:Is There a Smarter Path to Artificial Intelligence? Some ... by garmaine on Friday June 22, 2018 @02:37AM (#17371893)
I have never once encountered this misconception until now. Every explanation of deep learning I’ve seen begins with an explanation of the origin of the phrase.
Re:Is There a Smarter Path to Artificial Intelligence? Some ... by IshKebab on Sunday June 24, 2018 @06:13AM (#17385879)
A few weeks ago someone submitted an entire article to HN that consisted of someone complaining that deep learning wasn't really deep, in the deep & meaningful sense. They clearly misunderstood. Was pretty funny.
Re:Is There a Smarter Path to Artificial Intelligence? Some ... by viewtransform on Thursday June 21, 2018 @06:27PM (#17369782)
"Dimension reduction" is what I would call it. Going from R^n to R^m n>m using parameterized non-linear high dimensional mappings.
Re:Is There a Smarter Path to Artificial Intelligence? Some ... by gaius on Thursday June 21, 2018 @08:04AM (#17364313)
Lets rename "Deep learning" to "Statistical Compression"

The previous name for what is now called “machine learning” was predictive statistics. But a better name for deep learning is “machine intuition” since it seems to work pretty well but can’t be readily explained

Re:Is There a Smarter Path to Artificial Intelligence? Some ... by FrozenVoid on Thursday June 21, 2018 @02:03PM (#17367694)
> can’t be readily explained

It works "pretty well" in well-defined complete-information domains like Go.

The training in that case is actually about improving the next dataset from which higher-quality patterns are extracted.

1.We have a NN that doesn't know how to play and makes random moves.

2.Blank slate dataset filled from random games.

3.NN learns to produce better games by weighting wins vs losses, making losing moves less likely and winning moves more likely.

4.NN produces slightly better dataset.

5.Repeat #3 until you have covered a large chunk of go openings and have pretty good estimation for move quality.

6.NN becomes the condensed statistic pattern data extracted from billions of games, able to estimate value of a move more accurately than humans.

Still in some rare cases it "condensed pattern database" will make mistakes due gaps in data or wrong correlation that NN hallucinated from its connections.

Re:Is There a Smarter Path to Artificial Intelligence? Some ... by gaius on Thursday June 21, 2018 @02:45PM (#17368116)
works "pretty well" in well-defined complete-information domains like Go

But no one can definitively say “my AI credit scoring system didn’t decline his mortgage because he is black” and that’s the explainability bar that needs to be passed.

Right now the state of it is “gut feel” with an unknown amount of unconscious bias.

Re:Is There a Smarter Path to Artificial Intelligence? Some ... by tim333 on Thursday June 21, 2018 @08:10PM (#17370232)
Same as humans really.
Re:Is There a Smarter Path to Artificial Intelligence? Some ... by garmaine on Friday June 22, 2018 @02:35AM (#17371887)
> since it seems to work pretty well but can’t be readily explained

That is becoming less and less true.

Re:Is There a Smarter Path to Artificial Intelligence? Some ... by gaius on Friday June 22, 2018 @03:00AM (#17371988)
We are a long, long way from cracking open a neural net cat classifier and pointing at the exact equation for the whisker coefficient or the nose cuteness factor.