News for hackers. Stuff that matters.
Re:New LLM optimization technique slashes memory costs up to... by m463 on Tuesday December 17, 2024 @12:27AM (#42438612)
Don't you think people will just add better models to meet available memory?

If we run 7B now, why wouldn't we run 700b with memory optimizations?

There are no comments on this comment yet.