Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Show HN: I made a GPU VRAM calculator for transformer-based models. Parent comment
IIRC you want micro-batching though, to overlap pipeline phases.
There are no comments on this comment yet.
IIRC you want micro-batching though, to overlap pipeline phases.