Apple isn't serious about AI and needs to figure their AI story out. Every other big tech company is doing something about it.
I wouldn't say Apple isn't serious about AI, they had the forethought to build the shared memory architecture with the insane memory bandwidth needed for these types of tasks, while at the same time designing neural cores specifically for small on-device models needed for future apps.
I'd say Apple is currently ahead of NVIDIA in just sheer memory available - which for doing training and inference on large models, it's kinda crucial, at least right now. NVIDIA seems to be purposefully limiting the memory available in their consumers cards which is pretty short sighted I think.
https://creativestrategies.com/mac-studio-m3-ultra-ai-workst...
RTX 5090 only has 32GB RAM. M3 Ultra has up to 512 GB with 819 GB/sec bandwidth. It can run models that will not fit on an RTX card.
EDIT: Benchmark may not be properly utilizing the 5090. But the M3 Ultra is way more capable than an entry level RTX card at LLM inferencing.
Nvidia makes an incredible product, but apples different market segmentation strategy might make it a real player in the long run.
16x the RAM of RTX 5090.
There are two versions of the M3 Ultra
28-core CPU, 60-core GPU
32-core CPU, 80-core GPU
Both have a 32-core Neural Engine.