Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on New LLM optimization technique slashes memory costs up to 75%. Parent comment
If we run 7B now, why wouldn't we run 700b with memory optimizations?
There are no comments on this comment yet.
If we run 7B now, why wouldn't we run 700b with memory optimizations?