News for hackers. Stuff that matters.
Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by josephg on Tuesday August 25, 2026 @05:38PM (#49441031)
I think LLMs will start being etched into custom chips. There’s already some companies experimenting with it. The benefits are enormous - you get better performance, lower memory usage and no need to load a model in ram. Companies would be able to sell local LLMs while keeping their models proprietary.

If that happens, hopefully the ram price comes back to earth.

Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by switchbak on Tuesday August 25, 2026 @11:12PM (#49443790)
I’d love to buy a tiny swappable coprocessor that slots in next to my cpu and can take this stuff on. Swap it out every 8 months as you can benefit from something better. Hell, sign me up for a subscription!