News for hackers. Stuff that matters.
Re:The AI Index 2019 Report by ummonk on Monday December 16, 2019 @11:16AM (#21804108)
Both. Companies are certainly building bigger and bigger clusters for training.

At the same time though, consumer GPUs have gotten significantly faster (compare e.g. an Nvidia 2080TI to a 980TI), and learning algorithms keep improving / better learning algorithms become more widely used (e.g. Adam instead of stochastic gradient descent).

Re:The AI Index 2019 Report by antpls on Monday December 16, 2019 @02:58PM (#21806566)
And also, architectural search allowed for neural networks to use more efficient builtin blocks, using many less parameters, and achieving the same accuracy with smaller models (and lowering training cost)