Re:You might not need machine learning
by tgv on Tuesday November 24, 2020 @04:53AM
(#25196943)
It might not be a hard boundary, but I think the perception of ML vs. optimization is how much of a model you have. If all you have is a black box, then it's ML; if you know how the system you are studying works, it's (parameter) optimization.
[ Parent
| on HN ]
Re:You might not need machine learning
by mlthoughts2018 on Tuesday November 24, 2020 @07:57AM
(#25198014)
That’s a very unfair distinction, almost like a No True Scotsmam fallacy to say machine learning is only bad and other stuff is only good (in terms of transparency).
But machine learning has predated neural networks by hundreds of years. The core mathematical basis of all machine learning coursework linear regression and decision trees. Other models like SVMs, Bayesian models, nearest neighbor indexes, TFIDF text search, naive Bayes classifier, etc., are basically like machine learning 101, and they have many different properties regarding interpretability depending on the problem to solve.
Re:You might not need machine learning
by username90 on Tuesday November 24, 2020 @09:28AM
(#25198694)
Saying that linear regression is machine learning is like saying that newtons laws is chemistry. There was no machine learning before computers, just regular old optimization algorithms.
Re:You might not need machine learning
by disgruntledphd2 on Tuesday November 24, 2020 @09:58AM
(#25198989)
Yes, there was. It was just called statistical modelling.
There were no machines in the sense of ML in 1740.
Re:You might not need machine learning
by mlthoughts2018 on Saturday November 28, 2020 @03:14PM
(#25240153)
This is very false. Least squares regression fitting, Chebychev polynomial approximation, and maximum likelihhod estimators all existed at the time and those are all classic examples of standard machine learning. The term “machine learning” essentially encompasses any type of algorithm that expresses inductive statistical reasoning. Even just elementary school descriptive statistics is machine learning. “Machine learning” is a super old subfield of applied mathematics. The fact that the terminology “machine learning” didn’t exist until things like perceptron and SVMs came along is utterly irrelevant semantic hairsplitting.
Re:You might not need machine learning
by disgruntledphd2 on Tuesday November 24, 2020 @02:41PM
(#25202209)
But ML is essentially just function approximation, and that definitely existed back then.
I know this is super pedantic, but it's important to remember the roots of things, and that even things which appear new have precursors that are much older than a lot of people realise.