Your computer's abilities are the result of little switches flipping between two states.
I don't think this is a reductionist view of a computer. That's exactly what it is, and with a very little imagination describes what it has the capacity to do. What computers do now wouldn't be a surprise to people in the 1940s.
Similarly, you can say that deep learning is just a series of matrix multiplications with nonlinearities applied, which is true, but it certainly wasn’t obvious to most that when you scale that way up, that that would lead to computers being able to interpret images, sound, and text. For example, my AI course professor described neural nets as something of interest mostly for historical reasons, something that was tried, but was an evolutionary dead end. And he was no slouch.
The hype has gotten ahead of its current abilities, but I simultaneously think that it will be one of the most impactful inventions we’ve ever created.
This statement is one of the things I find most fascinating about the current state of AI. Do I think deep learning is incredibly useful? Absolutely and I look forward to seeing more awesome stuff done with it in the future.
Do I think the singularity or "true" AI will be based on deep learning? Not really. I strongly suspect anything capable of reaching scifi levels of intelligence (which a lot of hype says or strongly implies is imminent) will have to be a difference of kind, not of degree.
I could be wrong, of course, but it will be interesting to wait and see.
But I'm also guessing we'll come up with an endless number of complex tweaks to get the current stuff closer before someone figures out the simple mechanics and sweeps most of that away.
Yes, I'm not disagreeing with any of that (see also my other reply), it was a misuse of terminology on my part.
> But mostly I agree with you: modeling is horse shit, worshipping models...
Absolutely. The way I see it is that models are like theorems: they are useful and worthy of being studied, but if you forget to validate that your hypotheses are correct, you get wrong results: garbage in, garbage out.
An alarming amount of stuff these days is the equivalent of people trying to apply the pythagorean theorem to a non-rectangle triangle and then complaining the results don't match.