Re:Tim Cook holds company-wide meeting to address Apple's AI...
by seanmcdirmid on Friday August 01, 2025 @10:36PM
(#44764483)
Silicon Mac’s are great for running LLMs. Unified memory and memory bandwidth of the Max and Ultra processors is very useful in doing inference locally.
[ Parent
| on HN ]
Re:Tim Cook holds company-wide meeting to address Apple's AI...
by bigyabai on Friday August 01, 2025 @10:42PM
(#44764510)
Great news, but entirely lost on commercial hyperscalers and much of the PC market. Apple's recalcitrance towards supporting Nvidia drivers basically killed their last shot at real-world rackmount deployment of Apple Silicon. Now you can go buy an ARM Grace CPU that does the same thing, but cheaper and with better software support.
Re:Tim Cook holds company-wide meeting to address Apple's AI...
by seanmcdirmid on Saturday August 02, 2025 @01:58AM
(#44765180)
You really can’t. NVIDIA’s arm chip still looks nerfed compared to apple’s offering, and…I can run 40GB sized LLMs on the plane with no internet…it’s not something that you can do with any other platform.