Re:High Performance Computing: Are We Just Getting Wrong Ans...
by jedbrown on Wednesday September 26, 2018 @03:34PM
(#18079464)
I don't know what domain you work in. The modest 1986 editorial statement from the Journal of Fluids Engineering is still pretty much a gold standard for rigor in real-world applications and is exceedingly rarely achieved in domains where direct observational data is hard to come by (most of geophysics, much of biophysics, etc.). E.g., https://jedbrown.org/files/20160912-NumericalAccuracy.pdf
I think it is interesting to compare this old panic with ML work. Without gazillions of flops the neural network approach was dead. After a few years it became clear that float/double precision was useless, and now for certain problems half precision is standard.
Where one resource (people, CPU, ram, money) is the fixed constraint, other factors will be tweaked to compensate.