News for hackers. Stuff that matters.
Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by backpropaganda on Sunday May 07, 2017 @07:04AM (#14284870)
Machine learning has departed from the venture of understanding-based science much before deep learning [1][2]. Thus, singling out deep learning reeks of motivated reasoning or just lack of awareness of the history of machine learning.

Having said that, there still exists the lunatic fringe (it's a compliment) inside deep learning who continue to work on the task of generative modeling in the hope of "understanding the world" rather than "solving a task". Yoshua Bengio and Yann LeCun don't miss an opportunity to impress on the world how important unsupervised learning is.

Physics too has abandoned understanding for predictive power. If you take philosophy of science seriously, you either have to pick "science is whatever the elite society believes in (Kuhn)" or "science gives us tools for prediction (Post-Kuhn)". Claiming that science helps in finding truth or understanding, is going to put you in a very indefensible slippery slope.

"Understanding" is a subjective human concept, and not worth pursuing. Humans evolved to run from tigers, and struggle with harder tasks like understanding quantum mechanics or understanding the brain. The directionality of scientific progress as evidenced by QM is not "understanding", but tooling and predictive power. I hope Deep Learning is going to follow the path of predictive power, rather than regress into the pseudoscientific mess of elegance and understanding.

[1]: http://www2.math.uu.se/~thulin/mm/breiman.pdf

[2]: http://norvig.com/chomsky.html

Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by bamboozled on Sunday May 07, 2017 @08:16AM (#14285078)
"Understanding" is a subjective human concept, and not worth pursuing."

Isn't human understanding of how our environment works precisely how you're able to sit in your chair and write comments on HN for others to read?

Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by cercatrova on Sunday May 07, 2017 @09:14AM (#14285295)
Sure but I might say that if I were to create a chair by generative methods, would I need to understand how it was created for it to be useful?
Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by bamboozled on Sunday May 07, 2017 @05:30PM (#14287792)
If you have ever crafted a chair, table, or anything else that is built by craftsperson, you will soon realise why such a profession exists, because it's very difficult.

You might slap a few pieces of wood together and by brute force, create something like a chair and that might do, but it's very unlikely to be a good, safe, attractive, comfortable long lasting chair. Building quality furniture is complex and difficult work which takes a lot of skill, experience and understanding in order to do.

I understand your point, I never said there is anything wrong with experimenting with NNs, I just don't agree with the OPs sentiment.

Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by backpropaganda on Sunday May 07, 2017 @02:42PM (#14286844)
No. Tools enabled it, not understanding.
Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by j2kun on Sunday May 07, 2017 @04:23PM (#14287427)
Give one specific example of a widespread modern invention that did not require any understanding to create. You personally can use a tool without understanding how it's made, but you seem to claim the tools are invented without anyone's understanding.
[dead]
Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by YeGoblynQueenne on Monday May 08, 2017 @07:24AM (#14290692)
Noone understands quantum mechanics but you will tell this scientistic community what quantum mechanics is, because you know what it is even if noone understands it.

Sorry you're being downvoted but you're the one who's just throwing buzzwords around that you poorly understand. That's the definition of scientism, right there.

Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by backpropaganda on Monday May 08, 2017 @10:21AM (#14291663)
I don't understand QM, and no self-respecting physicist claims to understand it either. The consensus is pretty strong on this. QM is strange, the Standard Model is strange, but it works. I'm kinda surprised people like you are not aware of this simple fact. We don't live in 1700s anymore, and aren't in the world of high-school physics. Things are strange now, and the data-backed equations have replaced understanding. I can understand that people want science to explain things, but that's simply not the reality any more.
Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by YeGoblynQueenne on Monday May 08, 2017 @07:10PM (#14296454)
OK, seriously. How are you in a position to know what is the consensus among quantum phycisists, or anything much about quantum mechanics? Are you a quantum phycisist? A soft eng at CERN?

And what exactly do you mean "people like me"? Please don't do that.

Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by backpropaganda on Monday May 08, 2017 @08:58PM (#14296928)
I listen to public talks by people like Max Tegmark, Lawrence Krause, etc.
Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by YeGoblynQueenne on Tuesday May 09, 2017 @10:18AM (#14300186)
That's not how you figure out what the consensus is. At best, you may get an idea of what the person speaking believes (or wants you to believe) the consensus is, but researchers always have their own opinions and their own agenda so you can't really rely on talks and articles in the lay press.

To be able to say that you know what the consensus is in any given field the gold standard must be what scientists in that field do: read about 250 papers each year for a few years, speak to as many other researchers as possible and go to a few conferences and workshops, until you really understand were things are and how they are moving along.

I appreciate that's a high standard, but that's the general idea. If you can't do that, then at least be aware of the fact that the opinion you have formed is not terribly informed and you 're not any kind of authority on the matter.

Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by YeGoblynQueenne on Monday May 15, 2017 @08:55AM (#14341156)
>> Physics too has abandoned understanding for predictive power. If you take philosophy of science seriously, you either have to pick "science is whatever the elite society believes in (Kuhn)" or "science gives us tools for prediction (Post-Kuhn)". Claiming that science helps in finding truth or understanding, is going to put you in a very indefensible slippery slope.

This may be threadomancy, but I kept thinking about your comments and I realise now that there is a huge confusion between the different ways that the word "prediction" is used in the sciences.

What you mean when you say that you can use quantum theory to "make predictions" is that you can plug in some values to the formulae and come up with other values- the position or speed of particles and so on. This is a "prediction" in terms of stochastic determination of the state of the world within a probabilistic framework: you "predict" the values that some random variables will take.

On the other hand, what is more commonly meant by "prediction" in the sciences is the ability to anticipate novel observations, phenomena that have not been observed yet. For a famous example, phycisists and mathematicians predicted the existence of black holes before those were observed by astronomers.

This ability to foresee as-yet unseen phenomena is the true power of scientific theories, the context in which "prediction" is most often used in the sciences, and something that cannot be achieved without a thorough understanding of said theories. You can't take a black-box model of pictures of dog breeds and make a guess about what other kinds of dog breeds might exist, or might be created, than the ones in the original training set. The model may even be capable of doing that- but you, the person training it, are none the wiser. You can't use the model to expand your knowledge about the world. It's a closed loop.

So it's not really "predicting" anything in the way you say it, the way Kuhn meant it or anyone else means it.

Re:Deep Learning’s Impact on Image Processing, Mathematics, ... by throwaway29292 on Sunday May 07, 2017 @04:37PM (#14287518)
It is fascinating to see in real life, how science-fiction style AI is becoming a reality, where nobody understands how machines produce their answer. Given a few more decades, I'm sure the Asimov short story - The Feeling of Power - will become culturally relevant.