News for hackers. Stuff that matters.
Re:Troubling Trends in Machine Learning Scholarship by jimbofisher1 on Wednesday July 11, 2018 @10:42AM (#17507309)
People have literally done this analysis and the finding was that most gains were the result of improved hyperparamaters. Why is this controversial?
Re:Troubling Trends in Machine Learning Scholarship by joe_the_user on Wednesday July 11, 2018 @01:21PM (#17508606)
References? I mean, I in fact believe this, none of my post above was arguing with the basic point. Rather, my point literally that this is controversial because this testing is hard. You can't just write a loop over all papers, hardware configurations and so-forth. I can't imagine a given paper would do more than look at a handful of papers, do some common sense reasoning and some statical reasoning. And from the common sense side of it, yeah, seems logical but the problem is that's less than absolute and as the OP and my GP note, researchers have incentive to write "that one paper where the architecture really matters"