News for hackers. Stuff that matters.
Re:Apple M3 Ultra by behnamoh on Wednesday March 05, 2025 @09:45AM (#43267112)
> My guess is that Apple developed this chip for their internal AI efforts

what internal AI efforts?

Apple Intelligence is bunkers, and Apple MLX framework remains a hobby project for Apple

Re:Apple M3 Ultra by InTheArena on Wednesday March 05, 2025 @09:52AM (#43267265)
Apple stated that they were deploying their own hardware for next generation Siri. My thesis is that this is the hardware they developed.

If so, this is hardly a hobby project.

It may not be effective, but there is serious cash behind this.

Re:Apple M3 Ultra by gatienboquet on Wednesday March 05, 2025 @09:53AM (#43267276)
They use their own M chips for IA. They are far more advanced on AI than the majority of company.

They are using OpenAI for now but in couple months they will own the full chain of value.

Re:Apple M3 Ultra by behnamoh on Wednesday March 05, 2025 @02:59PM (#43271515)
we’ve heard that claim for the past three years, but every effort by them points to the opposite. don’t get me wrong, I would love for Apple Intelligence to be smart enough on my iPhone and on my Mac, but honestly, the current version is a complete disappointment.
Re:Apple M3 Ultra by DrBenCarson on Wednesday March 05, 2025 @03:30PM (#43271900)
Apple are working on the hard problems of making AI useful (call them “agents”), not AGI

1. Small models running locally with well-established tool interfaces (“app intents”)

2. Large models running in a bespoke cloud that can securely and quickly load all relevant tokens from a device before running inference

No AI lab is even close to what Apple is trying to deliver in the next ~12 months

Re:Apple M3 Ultra by behnamoh on Wednesday March 05, 2025 @06:48PM (#43274401)
if that were the case, then it would definitely help Apple Intelligence if the iPhone and Mac had higher amounts of RAM, but the base MacBook Pro announced by Apple a while ago had 8 GB of RAM and even the pro versions of the iPhone have 8GB whereas 12, 16, or even higher RAM is very common in android devices which helps users run relatively large language models on their devices
Re:Apple M3 Ultra by DrBenCarson on Thursday March 06, 2025 @06:37AM (#43278993)
All iPhone SoCs made after ChatGPT launched start with 8gb, and all Mac SoCs start with 16hlgb
Re:Apple M3 Ultra by behnamoh on Thursday March 06, 2025 @08:56AM (#43280214)
Re:Apple M3 Ultra by seec on Thursday March 06, 2025 @01:40PM (#43283596)
They were more "advanced" with the Siri release also, yet today it is barely competitive with the other assistant.

Apple is very good at marketing, a lot less at delivering actual value, especially if it's not about hardware.

Re:Apple M3 Ultra by Spooky23 on Wednesday March 05, 2025 @10:13AM (#43267602)
They’re taking a different and more difficult path of integrating AI with existing apps and workflows.

It’s their spin of the Google strategy of targeting providjng services to their enterprise GCP customer. I think we’ll see more out of them long term.

Re:Apple M3 Ultra by DrBenCarson on Wednesday March 05, 2025 @10:44AM (#43268081)
Apple have been putting ML models running on their own silicon into production for far longer than any of their competitors. They publish some of the most innovative ML research

They also own distribution to the wealthiest and most influential people in the world

Don’t get lost in recency bias