News for hackers. Stuff that matters.
Re:DeepSeek 4 Flash local inference engine for Metal by zozbot234 on Friday May 08, 2026 @02:49PM (#48067165)
Anything can technically "run" on almost any hardware, the meaningful question is what's the real-world performance. I for one have made a case in this thread that DeepSeek V4 is de facto optimal for wide batching, not single-request or single-agent inference - even on consumer hardware (which is unique among practical AI models). I might still be wrong of course, but if so I'd like to understand what's wrong with my assumptions.

There are no comments on this comment yet.