News for hackers. Stuff that matters.
Re:Apple's Slow AI Pace Becomes a Strength as Market Grows W... by danaris on Tuesday December 09, 2025 @07:21PM (#46212529)
From what I can tell, only Apple even wants to try doing any of the processing on-device. Including parsing the speech. (This may be out-of-date at this point, but I haven't heard of Amazon or Google doing on-device processing for Alexa or Assistant.)

So there's no way for them to do anything without sending it off to the datacenter.

Re:Apple's Slow AI Pace Becomes a Strength as Market Grows W... by delecti on Tuesday December 09, 2025 @08:07PM (#46212842)
Alexa actually had the option to process all requests locally (on at least some hardware) for the first ~10 years, from launch until earlier this year. The stated reason for removing the feature was generative AI.
Re:Apple's Slow AI Pace Becomes a Strength as Market Grows W... by miyoji on Wednesday December 10, 2025 @10:17AM (#46218621)
> (This may be out-of-date at this point, but I haven't heard of Amazon or Google doing on-device processing for Alexa or Assistant.)

It was out of date 6 years ago.

"This breakthrough enabled us to create a next generation Assistant that processes speech on-device at nearly zero latency, with transcription that happens in real-time, even when you have no network connection." - Google, 2019

https://blog.google/products/assistant/next-generation-googl...

Re:Apple's Slow AI Pace Becomes a Strength as Market Grows W... by foobiekr on Wednesday December 10, 2025 @04:27PM (#46224114)
It's an obvious cost optimization. Make the consumer directly cover the cost of inference and idle inference hardware.