News for hackers. Stuff that matters.

A comment on Apple introduces M6 and M5 Ultra for a big leap in performance and AI compute. Parent comment

Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by Humphrey on Tuesday August 25, 2026 @09:40PM (#49443141)
I wonder when/if we will start to see Apple include a silicon encoded model into their chips. Similar to Taalas build Llama 3.1 silicon with 17,000 tok/s inference.

So could the M7 actually include an AFM 3B model, alongside a generic neural engine?

[ Parent | on HN ]
Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by wmf on Wednesday August 26, 2026 @01:01AM (#49444178)
That model would be larger and more expensive than the entire M7 chip.
[ Parent | on HN ]
Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by tyre on Wednesday August 26, 2026 @01:13AM (#49444265)
Why would a local model for a consumer device need 17k tok/s?

Apple is better off building chips with generalizable TPUs (or equivalent) so they can upgrade/patch models.

[ Parent | on HN ]
Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by MaxikCZ on Wednesday August 26, 2026 @01:51AM (#49444531)
I cant shake the feeling of "640KB is enough for everybody". Imagine not one AI answering over 1 minute but a team of 100+ agents in hieararchical structure taking care of your request in seconds, checking each other.
[ Parent | on HN ]
Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by jeffybefffy519 on Wednesday August 26, 2026 @06:58AM (#49446852)
It would open heaps of use cases, you could almost pass it over frames of images the camera sees in real time for example...
[ Parent | on HN ]
Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by dyauspitr on Wednesday August 26, 2026 @03:34AM (#49445266)
It would make zero sense. These things are improving by leaps and bounds every week, we are not at the point where you can burn weights into silicon and put it on one of the largest consumer devices on the planet yet.
[ Parent | on HN ]
Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by aqfamnzc on Wednesday August 26, 2026 @09:56AM (#49449283)
On the other hand, models these days are getting to the point where even if all development halted permanently, they would continue to be useful long into the future. (At least until their knowledge base or linguistics become too outdated.)
[ Parent | on HN ]