Re:Machine Learning: The Great Stagnation
by BlueTemplar on Friday January 15, 2021 @05:41AM
(#25789242)
> An analogy from a couple years ago is bridge building before physics. You accumulate rules of thumb, you get a vague understand what works. You get better. But you aren't producing a systematic field.
This would be more like Kuhn's pre-paradigmatic (pre-scientific) activity, than moving from one scientific paradigm to another ?
https://samzdat.com/2018/05/19/science-under-high-modernism/
(I don't know which one is more appropriate here.)
Yeah - SVM were considered to be optimal, then they got smashed by deep networks, now people keep bringing them back and saying "they are just as good" and yet deep networks keep being used to do all the breakthrough work.
So I'd claim we're really at the situation right now, at the exploring new ideas, the "crisis of science" phase where essentially people have to start brainstorming (and not all ideas are good here either but they need to be somewhat original).
All this is using Thomas Kuhn's Structure Of Scientific Revolutions model very roughly.