News for hackers. Stuff that matters.
Re:Bugs in LLM Training – Gradient Accumulation Fix by danielhanchen on Friday October 18, 2024 @02:38PM (#41882219)
Yes exactly- mathematically it was incorrect to begin with.

There are no comments on this comment yet.