News for hackers. Stuff that matters.
Re:I think Anthropic and OpenAI have found product-market fit by xyhopguy on Wednesday May 27, 2026 @07:30PM (#48302209)
Microbatch size is a hyperparameter, it can be set to 1 and work just as effectively. With gradient accumulation it's equivalent even. Large batch sizes are used to increase parallelism, and sometimes to reduce variance in the loss signal (at the cost of increased bias).

Batch size is frequently limited by compute bottlenecks well before memory.

There are no comments on this comment yet.