News for hackers. Stuff that matters.
Re:New LLM optimization technique slashes memory costs up to... by mandmandam on Tuesday December 17, 2024 @06:41AM (#42440557)
> I didn’t expect capable language models to be practical/possible to run loyally

Now there's a fun typo. Hopefully not too much fun.

Re:New LLM optimization technique slashes memory costs up to... by momojo on Tuesday December 17, 2024 @02:44PM (#42444537)
That sentence triggered memories of reading the huge paperback Asimov compilation my mom kept on the bookshelf as a kid.