Re:Show HN: Llmspeed – feel how fast a local LLM runs before...
by albinstman on Saturday October 17, 2026 @03:02AM
(#50128660)
I’ll look into adding harnesses. The benchmark sources usually don’t contain harness so the problem is limited data. What models would you like to see?
[ Parent
| on HN ]
Re:Show HN: Llmspeed – feel how fast a local LLM runs before...
by bozdemir on Saturday October 17, 2026 @03:52AM
(#50128907)
For example you might add Strata & Qwen 3.8 Flash Next with some quantizations. Nowadays it is a go to selection and very sought after MoE model.
Re:Show HN: Llmspeed – feel how fast a local LLM runs before...
by albinstman on Saturday October 17, 2026 @04:09AM
(#50128990)
Qwen 3.8 flash next is already in the works and should be live soon.
Re:Show HN: Llmspeed – feel how fast a local LLM runs before...
by albinstman on Saturday October 17, 2026 @12:11PM
(#50132337)
New model/hardware benchmarks is now live
Re:Show HN: Llmspeed – feel how fast a local LLM runs before...
by cyanydeez on Saturday October 17, 2026 @03:17AM
(#50128740)
He's exagerating, I hope. The only bottleneck a harness attachs is pre-context fill and whatever tooling is installed. A proper harness reduces these to negligable startup costs.
Unless of course he's driving some weird lambo that dumps 200k of context into their chats. Who knows, I feel like we're on a yellow submarine.
Re:Show HN: Llmspeed – feel how fast a local LLM runs before...
by bozdemir on Saturday October 17, 2026 @03:50AM
(#50128901)
Exagerating? I setup llm endpoints on corporate level in a company on H200 gpus, that serves hundreds of software engineers, I have observed differences, even on different versions of nvidia drivers. I shared my day to day experience. It is more and more important if you have very limited VRAM like 24gb on a 4090 RTX desktop or RTX 5090 Laptop gpu. I set up and use llms on my personal devices also, when I can't use cloud models on classified company materials. Here is an example problem what I daily report and deal with.