As time rolls on and we see more articles like this one calling out the "AI BS" - which I agree should be called out...
I worry that a new "winter" will set in, and funding will be cut, and research towards how biological neural networks actually work vis-a-vis artificial neural networks will suffer.
Because from what I understand, we currently don't know how such biological networks actually "learn" - because there isn't a "mechanism" for backpropagation to occur.
IIRC, there's still questions on how information is propagated through biological networks; our artificial representations of them are constrained to approximately a single dimension of the real thing (and even that doesn't capture the biology, thus the idea of "spiking neural networks") - but there may be other avenues of information diffusion that are important as well, still to be revealed in the biological makeup.
We know for certain we are missing something fundamental, when even if you could scale up some of today's best deep learning systems to data center scale won't approximate anything close to what goes on in the human brain, given the size and power constraints.
Figuring this out could be set back, when funding becomes scarce once more.
AI might end up the same, enter a winter. people will talk about how silly endevours into AI where, but a few companies will really figure it out and a huge explosion will occur and people will wonder how anyone did anything without AI. something like that
for those who forgot what that winter was like: 1999 2:10: your not a pure internet company... (insinuating thats bad) https://www.youtube.com/watch?v=GltlJO56S1g&t=316s
.com bubble burst somewhere March, 2001
2002 2:22: netflix represents one of the few success stories of an otherwise desolute tech sector https://www.youtube.com/watch?v=YBLAwGhyV5k
2004 who in their right mind brings a company to market in the doldrums of august in a down tech... https://www.youtube.com/watch?v=HxOoeCHc47Q
That seems sufficiently “black-box-ish” to me?
Back-propogation is not an "AI" algorithm.
You are ironically doing exactly what this article is about.
My comment is making an entirely uncontroversial statement: that "backpropagation is an AI algorithm". Not that "backpropagation is AI". The latter could be taken to mean that backpropagation is itself artificially intelligent, that it exhibits some kind of intelligence (leaving aside for the moment the fact that we have no agreed upon definition of "intelligence", artificial or otherwise). If I understand your comment correctly, this is the interpretation you make of my comment.
However, what my comment says, and this should be clear from the context ("most researchers will agree"), is that backpropagation is an algorithm from the field of research that is known as AI.
In that context, "AI", "Artificial Intelligence", is the field of research that investigates methods to construct "AI", "Artificial Intelligence(s)". Backpropagation is a component of one such method, neural networks.
I think then that the confusion, which is also discussed, and exhibited, in the article, stems from the fact that the same word is used to describe both "artificial intelligence" and the field that researches artificial intelligence.
And I hope this clarifies the confusion.
Just saying "no it isn't" is just not helpful or useful.
You are the example it is making.
There are no accepted definitions of these terms. Are they meaningless?
AI that does not include backpropagation or logical deduction or GA's or optimisation is... is... magical thinking. AI without the nuts and bolts from the last 50 years of work is meaningless. The article is heartfelt, and we all agree with the tenant that people pretending that they are using AI when they are really using a database isn't a good thing, but if you take any current system look right down inside it all you will find is a Shannon type implementation of church-turing.
Backpropagation, which most researchers will agree is an AI algorithm, is a "simple algorithm".
So are many other AI algorithms, some of which are simple enough to be understood so well that most people don't recognise them as AI anymore: search algorithms like depth- breadth- or best-first search, game-playing algorithms like alpha-beta minimax, gradient descent/ hill climb, are the examples that readily come to mind.
I think the above article and your comment are assuming that, for an algorithm to be "AI" it must be very complicated and difficult to understand. This is common enough to have a name: "the AI effect". A few years down the line I bet people will say that "this is not AI, it's just deep learning".
There's no reason for AI algorithms to be complicated. Very simple algorithms can create enormous complexity, even infinite complexity. The state of deterministic systems with even a couple of parameters can become impossible to predict after a small number of steps if they have the chaos property. Language seems to be the application of a finite set of rules on a finite vocabulary to produce an infinite set of utterances. Complexity arises from very simple sources, in nature.