Re:Google Cloud TPU Multislice Training
by sillysaurusx on Friday November 10, 2023 @10:59PM
(#38227498)
Proof by contradiction: they used batch size 6 because 7 was past the point of diminishing returns. It’s ML tuning 101.
[ Parent
| on HN ]
There are no comments on this comment yet.