Re:Apple's AI Strategy in a Nutshell
by ydnaclementine on Tuesday June 11, 2024 @07:00AM
(#40644786)
Am I crazy to think that the claim of private cloud compute running M chips is marketing fluff? Is their ARM based SoC really as performant as a GPU at the scale they need?
[ Parent
| on HN ]
Does it need to be? When they can use their own SoC servers, they don't have buy hardware from other vendors or rent cloud compute capacity.
So it only needs to be so efficient that it will still cost less than those other options.
Re:Apple's AI Strategy in a Nutshell
by neilalexander on Tuesday June 11, 2024 @07:09AM
(#40644848)
I think these days Apple Silicon is more of an umbrella term for the packaging of their CPUs, GPUs and NPUs.
Internally it’s Project ACDC – Apple Chips in Data Centers.
https://www.wsj.com/tech/ai/apple-is-developing-ai-chips-for...
https://archive.ph/p4iuu
No real details.
Re:Apple's AI Strategy in a Nutshell
by superlopuh on Tuesday June 11, 2024 @07:14AM
(#40644884)
If they wanted to, why wouldn't they make a modified, specialized, server rack version of their hardware?
No one said they are M chips. These would be custom made for servers and AI inferencing. Also note their "ARM based SoC" has a GPU with 800 GB/sec bandwidth in the M2 Ultra.
Re:Apple's AI Strategy in a Nutshell
by ydnaclementine on Tuesday June 11, 2024 @07:51AM
(#40645137)
Not that it's a real source, but TFA states:
>These data centers will also run completely on Apple’s M chips
That guy is just some random blogger and I wouldn't take that to literally mean they use the same chips as a Macbook. Apple only says they use "Apple Silicon". Common sense to assume it is designed for servers and AI inferencing.