News for hackers. Stuff that matters.
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by JohnBooty on Tuesday January 07, 2025 @09:06AM (#42622421)
They have, because until now Apple Silicon was the only practical way for many to work with larger models at home because they can be configured with 64-192GB of unified memory. Even the laptops can be configured with up to 128GB of unified memory.

Performance is not amazing (roughly 4060 level, I think?) but in many ways it was the only game in town unless you were willing and able to build a multi-3090/4090 rig.

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by moralestapia on Tuesday January 07, 2025 @11:14AM (#42624005)
I would bet that people running LLMs on their Macs, today, is <0.1% of their user base.
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by sroussey on Tuesday January 07, 2025 @01:02PM (#42625314)
People buying Macs for LLMs—sure I agree.

Since the current MacOS comes built in with small LLMs, that number might be closer to 50% not 0.1%.

Re:Nvidia's Project Digits is a 'personal AI supercomputer' by moralestapia on Tuesday January 07, 2025 @03:59PM (#42627383)
I'm not arguing whether or not Macs are capable of doing it, but whether is a material force that drives people to buy Macs because of it; it's not.
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by justincormack on Tuesday January 07, 2025 @03:05PM (#42626764)
Higher than that buying the top end machines though, which are very high margin
Re:Nvidia's Project Digits is a 'personal AI supercomputer' by throwaway48476 on Tuesday January 07, 2025 @04:25PM (#42627711)
All macs? Yes. But of 192GB mac configs? Probably >50%