News for hackers. Stuff that matters.

A comment on Translating Between Statistics and Machine Learning. Parent comment

Re:Translating Between Statistics and Machine Learning by currymj on Tuesday November 20, 2018 @12:15PM (#18495490)
this is how I understand it. but then I’ve heard statisticians describe neural networks as “nonparametric”, even though they typically have a fixed number of parameters. (millions of parameters! arguably they are the MOST parametric.)
[ Parent | on HN ]
Re:Translating Between Statistics and Machine Learning by srean on Tuesday November 20, 2018 @12:51PM (#18495846)
Neural Network in general is indeed nonparametric because the number of weights are not something that is fixed in advance but learned from data. If they are considered fixed, for example for logistic regression then its considered parametric.
[ Parent | on HN ]
Re:Translating Between Statistics and Machine Learning by bonoboTP on Sunday November 25, 2018 @12:44AM (#18525626)
The number of parameters in aneural net as used today, specifically in computer vision, is basically never learned from training data. I actually cannot recall practically used methods that would do that.
[ Parent | on HN ]