News for hackers. Stuff that matters.
Re:Techniques for Training Large Neural Networks by rg111 on Friday June 10, 2022 @05:14AM (#31691772)
Dude, parallelization is exactly how non-trivial neural networks are trained since the beginning.

Parallel processing as in SIMD architecture is what makes Deep Learning possible now.

Parallel computing as in stacking graphics card is how literally everything is done everywhere- from big tech companies to not-so-well-funded data science departments in unknown unis.

You are so so off.

There are no comments on this comment yet.