News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by hylaride on Monday April 01, 2024 @01:53PM (#39896958)
The ones you can run on your own machine tend to be bad - really bad. They hallucinate wildly and fail at all sorts of tasks that the larger hosted ones succeed at.

Totally. I recently asked a locally-run "speed" LLM for the best restaurants in my (major) city, but it spit out restaurants opened by chefs from said city in other cities. It's not a thing you'd want to rely on for important work, but is still quite something.

There are no comments on this comment yet.