News for hackers. Stuff that matters.
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by quick_brown_fox on Tuesday January 07, 2025 @04:11AM (#42620719)
How about “We sell a computer called the tinybox. It comes in two colors + pro.

tinybox red and green are for people looking for a quiet home/office machine. tinybox pro is for people looking for a loud compact rack machine.” [0]

[0] https://tinygrad.org/#tinybox

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by kkzz99 on Tuesday January 07, 2025 @04:20AM (#42620758)
These look terrible. For 5 times the price you get worse performance.
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by nilstycho on Tuesday January 07, 2025 @10:14AM (#42623182)
Are you comparing tinybox red with 738 FP16 TFLOPS at $15K to Project Digits with 1 FP4 PFLOP at $3K? Or did they announce the Project Digits FP16 performance somewhere?
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by moffkalast on Tuesday January 07, 2025 @05:56AM (#42621266)
>tinybox

>the size of several ATX desktops

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by mft_ on Tuesday January 07, 2025 @07:35AM (#42621741)
This was my second thought; while we don’t have full performance data, it’s probably a bad day for tinybox.
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by loudmax on Tuesday January 07, 2025 @10:59AM (#42623779)
Going by the specs, this pretty much blows Tinybox out of the water.

For $40,000, a Tinybox pro is advertised as offering 1.36 petaflops processing and 192 GB VRAM.

For about $6,000 a pair of Nvidia Project Digits offer about a combined 2 petaflops processing and 256 GB VRAM.

The market segment for Tinybox always seemed to be people that were somewhat price-insensitive, but unless Nvidia completely fumbles on execution, I struggle to think of any benefits of a Tinygrad Tinybox over an Nvidia Digits. Maybe if you absolutely, positively, need to run your OS on x86.

I'd love to see if AMD or Intel has a response to these. I'm not holding my breath.

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by nilstycho on Tuesday January 07, 2025 @11:13AM (#42624000)
> For about $6,000 a pair of Nvidia Project Digits offer about a combined 2 petaflops processing and 256 GB VRAM.

2 PFLOPS at FP4.

256 GB RAM, not VRAM. I think they haven't specified the memory bandwidth.

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by loudmax on Tuesday January 07, 2025 @11:37AM (#42624313)
You're right. Tinybox's 1.36 petaflops is FP16 so that is a significant difference.

Also, the Tinybox's memory bandwidth is 8064 GB/s, while the Digits seems to be around 512 GB/s, according to speculation on Reddit.

Moreover, Nvidia's announced their RTX 5090s priced at $2k, which could put downward pressure on the price of Tinybox's 4090s. So the Tinybox green or pro models might get cheaper, or they might come out with a 5090-based model.

If you're the kind of person that's ready to spend $40k on a beastly ML workstation, there's still some upside to Tinybox.

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by elorant on Tuesday January 07, 2025 @02:12PM (#42626120)
You're missing the most critical part though. Memory bandwidth. It hasn't been announced yet for Digits and it probably won't be comparable to that of dedicated GPUs.