News for hackers. Stuff that matters.
Re:Google Cloud TPU Multislice Training by sillysaurusx on Friday November 10, 2023 @10:59PM (#38227498)
Proof by contradiction: they used batch size 6 because 7 was past the point of diminishing returns. It’s ML tuning 101.

There are no comments on this comment yet.