News for hackers. Stuff that matters.

A comment on Darkbloom – Private inference on idle Macs. Parent comment

Re:Darkbloom – Private inference on idle Macs by liuliu on Thursday April 16, 2026 @12:29PM (#47795842)
Of course these numbers are ridiculous. Mac Mini (let's assume Apple releases M5 Pro) tops Int8 (let's assume it is the same as FP8, which it is not) at ~50 TFLOPs, with Draw Things, we recently developed hybrid NAX + ANE inference, which can get you ~70 TFLOPs.

A H200 gives you ~4 PFLOPs, which is ~60x at only ~40x price (assuming you can get a Mac Mini at $1000). (Not to mention, BTW, RTX PRO 6000 is ~7x price for ~40x more FLOPs).

Your M4 Mac Mini only has ~20 TFLOPs.

[ Parent | on HN ]
Re:Darkbloom – Private inference on idle Macs by bentobean on Thursday April 16, 2026 @01:18PM (#47796571)
> Your computer only has ~20 TFLOPs.

What a time to be alive.

[ Parent | on HN ]