Re:Troubling Trends in Machine Learning Scholarship
by joe_the_user on Wednesday July 11, 2018 @01:41PM
(#17508761)
I seems like you're confusing an algorithm that could attain absolute maximum for hyperparameters with something could attain "good enough" values for hyperparameters.
After all, the models that work "well-enough" now, that attain state of the art results, don't have to have absolute best parameters but rather parameters that come from rules of thumb, trial-and-error and sometimes the 101-optimizations mentioned. I mean, we knows things work, there are working results, the challenge is determining exactly how these appear.
After all, the models that work "well-enough" now, that attain state of the art results, don't have to have absolute best parameters but rather parameters that come from rules of thumb, trial-and-error and sometimes the 101-optimizations mentioned. I mean, we knows things work, there are working results, the challenge is determining exactly how these appear.