News for hackers. Stuff that matters.
Re:Darkbloom – Private inference on idle Macs by eigengajesh on Thursday April 16, 2026 @06:48AM (#47791238)
The numbers are optimistically legit -- it's calculated based purely considering we have demand for all machines at all times. We don't have that right now, but fairly optimistic that people will do it.

That's why we don't recommend purchasing a new machine. Existing machine is no cost for you to run this.

Electricity is one cost, but it will get paid off from every request it receives. Electricity is only deducted when you run an inference. If you have any questions, DM me @gajesh on Twitter.

Re:Darkbloom – Private inference on idle Macs by stavros on Thursday April 16, 2026 @07:10AM (#47791384)
You're not taking into account the thermal strain on the machine, though. A machine that's 100% utilized (even worse if it's in bursts) will last less than an idle machine.
Re:Darkbloom – Private inference on idle Macs by embedding-shape on Thursday April 16, 2026 @07:26AM (#47791519)
> A machine that's 100% utilized (even worse if it's in bursts) will last less than an idle machine.

How much though? Say I have three Mac Minis next to each other, one that is completely idle but on, one that bursts 100% CPU every 10 minutes and one that uses 100% CPU all the time, what's the difference on how long the machines survives? Months, years or decades?

Re:Darkbloom – Private inference on idle Macs by washadjeffmad on Thursday April 16, 2026 @08:47AM (#47792213)
Not appreciably, and not before a 5-yr AppleCare+ warranty expires.

Out of our >3000 currently active Apple Silicon Macs, failures due to non-physical damage are in the single digits per year. Of those, none have been from production systems with 24/7 uptime and continuous high load, which reflects your parenthetical.

Perhaps we haven't met the other end of the bathtub curve yet, but we also won't be retaining any of these very far beyond their warranty period, much less the end of their support life.

Re:Darkbloom – Private inference on idle Macs by stavros on Thursday April 16, 2026 @08:54AM (#47792302)
I think the point of this is more "use the machine you have at home" than "do a TCO analysis and see if it's profitable", though. People like to keep their machines working for longer, generally.
Re:Darkbloom – Private inference on idle Macs by alsetmusic on Thursday April 16, 2026 @01:32PM (#47796761)
> Not appreciably, and not before a 5-yr AppleCare+ warranty expires.

It’s three years for Macs, though I believe you can pay annually for longer. Five has never been a thing to my knowledge.

Re:Darkbloom – Private inference on idle Macs by bbatsell on Thursday April 16, 2026 @01:38PM (#47796851)
AppleCare+ annual is perpetual as long as you keep paying it (and Apple offers to switch to that when your 3-year lump sum expires if you choose that instead). I’m guessing it ends whenever they officially discontinue hardware support, which has traditionally been about 7 years after the last unit is produced, but I haven’t reached that yet to know for sure.
Re:Darkbloom – Private inference on idle Macs by mbesto on Thursday April 16, 2026 @10:37AM (#47793628)
> That's why we don't recommend purchasing a new machine. Existing machine is no cost for you to run this.

You misunderstood. If the ROI is there, there is enough capital in existence for you to accelerate your profit. So why even deal with the complexity of renting people's hardware when you can do it yourself?

Re:Darkbloom – Private inference on idle Macs by splintercell on Thursday April 16, 2026 @09:52PM (#47801714)
No, what he's saying is that he expects this to be the ROI in the future because his product is so good.
Re:Darkbloom – Private inference on idle Macs by BuildTheRobots on Thursday April 16, 2026 @01:17PM (#47796548)
I don't worry about bandwidth or constant CPU use, but the one thing that will kill my mac is burning out the SSD.

The calculator gives numbers for nearly everything, but I can't obviously see how much space it needs for model storage or how many writes of temp files I should expect if I'm running flat out.

Re:Darkbloom – Private inference on idle Macs by sleepybrett on Thursday April 16, 2026 @03:12PM (#47798098)
put that stuff on an external disk perhaps, it will eventually crater, but it's easier to replace than macbook internal storage (how are they doing mac minis these days?)
Re:Darkbloom – Private inference on idle Macs by neurostimulant on Friday April 17, 2026 @01:51AM (#47802813)
Isn't high memory pressure will result in high memory paging which will wear down the internal ssd?
Re:Darkbloom – Private inference on idle Macs by MithrilTuxedo on Friday April 17, 2026 @12:18AM (#47802417)
I assumed you'd want to run one immutable model that can fit in memory without any temp files.
Re:Darkbloom – Private inference on idle Macs by dmitrygr on Thursday April 16, 2026 @03:37PM (#47798418)
> Existing machine is no cost for you to run this.

That is not at all how modern chips work. Idle chips are mostly powered down, non-idle ones are working and that causes real measurable wear and tear on the silicon. CPU, RAM, NAND all wear and tear measurably with use on current manufacturing processes.

https://en.wikipedia.org/wiki/Electromigration

Re:Darkbloom – Private inference on idle Macs by Barbing on Thursday April 16, 2026 @04:46PM (#47799284)
Like pitching "drive rideshares for only the cost of your time & gas"
Re:Darkbloom – Private inference on idle Macs by ta988 on Thursday April 16, 2026 @04:49PM (#47799319)
The question is, do they wear faster than they become obsolete, as in much more expensive to run than buying a new one with higher compute/watt. (and you can also factor in the ability to run latest models at usable speed)
Re:Darkbloom – Private inference on idle Macs by dmitrygr on Thursday April 16, 2026 @05:10PM (#47799544)
It’s complicated. When you design with modern PDKs, you consider the expected duty cycle of the device, expected temps, and the wear and tear on the silicon all together. That affects the layout of the chip as well as certain choices about widths of various features. Generally, one designs consumer SoCs to last 10 years with the expected duty cycle (low). With more wear you could run out of your “years" much faster, maybe even before the warranty.
Re:Darkbloom – Private inference on idle Macs by LPisGood on Thursday April 16, 2026 @05:40PM (#47799858)
My question is why did you have to design this to use an MDM instead of a simple program running in the terminal or something?