News for hackers. Stuff that matters.
Re:How AI Training Scales by gwern on Friday December 14, 2018 @08:18PM (#18686393)
I think it would be difficult to even test batchsizes of 1 in a reasonable time, assuming there exists a sufficiently small learning rate to allow progress. How many wallclock centuries would it take to verify that a minibatch of 1 works for the OA5 DoTA bot?

There are no comments on this comment yet.