News for hackers. Stuff that matters.
Re:DeepSeek v4 by Liftyee on Friday April 24, 2026 @03:09PM (#47894545)
What hardware do you use?
Re:DeepSeek v4 by tclancy on Friday April 24, 2026 @11:00PM (#47898232)
All of it.
Re:DeepSeek v4 by MezzoDelCammin on Saturday April 25, 2026 @06:24AM (#47900267)
I think the answer to this is:"yes"
Re:DeepSeek v4 by CoolThings on Saturday April 25, 2026 @07:04AM (#47900459)
a Beowulf cluster of 256 x Raspberry Pi 3.
Re:DeepSeek v4 by hhh on Sunday April 26, 2026 @09:09AM (#47910039)
I used to maintain a 2000 pi 4 cluster, before LLMs were relevant, with around 6gb free ram per node. I wonder what I could have done with something like this.
Re:DeepSeek v4 by Terretta on Monday April 27, 2026 @08:36AM (#47920794)
Most of those have custom quants for Mac Studio M3 Ultra 512GB. You'll typically see them mention it by name.

All of that list but the last three run at these sizes. For last three, look for a custom quant, e.g. 9.5 bits and/or the Ultra M3 512GB mention.

Not sure which direction I'm surprised but Macbook Pro M5 Max ticks over models at the same speed. With "only" 128GB look for models of 116 GB (the absolute max that retains reasonable stability) or less.