Re:How AI Training Scales
by gwern on Friday December 14, 2018 @08:18PM
(#18686393)
I think it would be difficult to even test batchsizes of 1 in a reasonable time, assuming there exists a sufficiently small learning rate to allow progress. How many wallclock centuries would it take to verify that a minibatch of 1 works for the OA5 DoTA bot?
[ Parent
| on HN ]
There are no comments on this comment yet.