News for hackers. Stuff that matters.
Re: by mwitiderrick on Sunday October 15, 2023 @10:48AM (#37890234)
"What’s impressive is that the sparse fine-tuned LLM can achieve 7.7 tokens per second on a single core and 26.7 tokens per second on 4 cores of a cheap consumer AMD Ryzen CPU."