Re:DS4, a specialized inference engine for DeepSeek v4 Flash
by shay_ker on Thursday May 07, 2026 @11:54AM
(#48050927)
How does it compare to popular local inference engines, e.g. ollama, lm studio, or handrolled llama.cpp? I saw a brief benchmark in the readme but wasn't sure if there was more.
Re:DS4, a specialized inference engine for DeepSeek v4 Flash
by speu on Thursday May 07, 2026 @12:42PM
(#48051551)
I've been trying deepseek-v4-flash in OpenCode (via OpenRouter) and I'm blown away. It's no Opus, obviously, but it had zero issues with any regular coding task I threw at it. v4-flash is remarkably "good enough" for what I needed. The whole evening of coding cost me $0.52 in API credits.
While it’s pretty fast in the official app for example.
Kagi Assistant is also kind of broken when using Qwen 3.6 Plus.
So, beware of using them in Kagi at the moment.
Looking at https://openrouter.ai/deepseek/deepseek-v4-flash/providers tells us that the deepseek provider achieves 49tps of throughput while deepinfra 19tps.