Re:Nvidia's Project Digits is a 'personal AI supercomputer'
by bloomingkales on Tuesday January 07, 2025 @07:08AM
(#42621585)
My $800 computer from two years ago playes modern games at 144hz at 1440p and runs 8gb models locally really fast. I’m about a $500 you upgrade away from running 16gb models and playing at 4k.
You are so late to this party it’s not even funny. It’s affordable and available.
Re:Nvidia's Project Digits is a 'personal AI supercomputer'
by wkat4242 on Tuesday January 07, 2025 @09:12AM
(#42622473)
32gb as of last night :)
Re:Nvidia's Project Digits is a 'personal AI supercomputer'
by WaxProlix on Tuesday January 07, 2025 @09:15AM
(#42622505)
The new $2k card from Nvidia will be 32GB but your point stands. AMD is planning a unified chiplet based GPU architecture (AI/data center/workstation/gaming) called UDNA, which might alleviate some of these issues. It's been delayed and delayed though - hence the lackluster GPU offerings from team Red this cycle - so I haven't been getting my hopes up.
Maybe (LP)CAMM2 memory will make model usage just cheap enough that I can have a hosting server for it and do my usual midrange gaming GPU thing before then.
Re:Nvidia's Project Digits is a 'personal AI supercomputer'
by FuriouslyAdrift on Tuesday January 07, 2025 @02:46PM
(#42626549)
Unified architecture is still on track for 2026-ish.
Re:Nvidia's Project Digits is a 'personal AI supercomputer'
by sliken on Tuesday January 07, 2025 @03:57PM
(#42627370)
Grace + Hopper, Grace + blackwell, and discussed GB10 are much like the currently shipping AMD MI300A.
I do hope that a AMD Strix Halo ships with 2 LPCAMM2 slots for a total width of 256 bits.
I have a bit of an interest in games too.
If I could get one platform for both, I could justify 2k maybe a bit more.
I can't justify that for just one half: running games on Mac, right now via Linux: no thanks.
And on the PC side, nvidia consumer cards only go to 24gb which is a bit limiting for LLMs, while being very expensive - I only play games every few months.