News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by kalleboo on Monday April 01, 2024 @06:25AM (#39892548)
I had downloaded some LLMs to run locally just to experiment when a freak hailstorm suddenly left me without internet for over a week. It was really interesting to use a local LLM as a replacement for Google.

It gave me a new mental model for LLMs rather than a "spicy autocomplete" or whatever, I now think of it as "a lossy compressed database of knowledge". Like you ran the internet through JPEG at 30% quality.

Re:LLaMA Now Goes Faster on CPUs by pizzafeelsright on Monday April 01, 2024 @10:57AM (#39894791)
Feels like that really smart friend who is probably correct but ya just don't know.