News for hackers. Stuff that matters.
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by stuaxo on Tuesday January 07, 2025 @04:36AM (#42620854)
It's annoying I do LLMs for work and have a bit of an interest in them and doing stuff with GANS etc.

I have a bit of an interest in games too.

If I could get one platform for both, I could justify 2k maybe a bit more.

I can't justify that for just one half: running games on Mac, right now via Linux: no thanks.

And on the PC side, nvidia consumer cards only go to 24gb which is a bit limiting for LLMs, while being very expensive - I only play games every few months.

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by bloomingkales on Tuesday January 07, 2025 @07:08AM (#42621585)
My $800 computer from two years ago playes modern games at 144hz at 1440p and runs 8gb models locally really fast. I’m about a $500 you upgrade away from running 16gb models and playing at 4k.

You are so late to this party it’s not even funny. It’s affordable and available.

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by wkat4242 on Tuesday January 07, 2025 @09:12AM (#42622473)
32gb as of last night :)
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by WaxProlix on Tuesday January 07, 2025 @09:15AM (#42622505)
The new $2k card from Nvidia will be 32GB but your point stands. AMD is planning a unified chiplet based GPU architecture (AI/data center/workstation/gaming) called UDNA, which might alleviate some of these issues. It's been delayed and delayed though - hence the lackluster GPU offerings from team Red this cycle - so I haven't been getting my hopes up.

Maybe (LP)CAMM2 memory will make model usage just cheap enough that I can have a hosting server for it and do my usual midrange gaming GPU thing before then.

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by FuriouslyAdrift on Tuesday January 07, 2025 @02:46PM (#42626549)
Unified architecture is still on track for 2026-ish.
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by sliken on Tuesday January 07, 2025 @03:57PM (#42627370)
Grace + Hopper, Grace + blackwell, and discussed GB10 are much like the currently shipping AMD MI300A.

I do hope that a AMD Strix Halo ships with 2 LPCAMM2 slots for a total width of 256 bits.