News for hackers. Stuff that matters.
Re:DeepSeek 4 Flash local inference engine for Metal by iuffxguy on Thursday May 07, 2026 @10:42PM (#48057851)
This is more then just the hardware evolving over time but we also are seeing big improvements in quantization and efficiency improvements.
Re:DeepSeek 4 Flash local inference engine for Metal by dakolli on Thursday May 07, 2026 @11:18PM (#48058099)
There are physical limits to how much you can compress data. I'm just saying, don't sit on your hands waiting for this to happen, becuase its probably not going to for another decade +. There's no use in waiting, just write the code your fkin self and stop being lazy.