News for hackers. Stuff that matters.
Re:Google's AI answers reducing search traffic by 40% by no-name-here on Wednesday November 18, 2026 @01:04AM (#50542423)
Cloud-hosted remains more efficient in terms of electricity, RAM use for large GB models, etc.

However, Apple is already including LLM models automatically with even iOS that can be queried for historical facts, etc.

Re:Google's AI answers reducing search traffic by 40% by oblio on Wednesday November 18, 2026 @04:27AM (#50543973)
I'm half optimistic about this, but we're so far from it from a hardware point of view.

We need unified memory for almost everything for these types of setups to be usable and we also need to standardize LLMs, if everyone wants to run their own LLM locally, that will probably be untenable for decades. We probably need new DRAM tech (3D RAM?).

Hardware prices need to go down a lot, and we're probably 5+ years away from that. Not only do prices need to go back to where they were, they need to become even lower. So we're probably 10+ years away from usable good enough local LLMs for the masses.

It's going to be an ugly decade from a hardware economics point of view. The potential is endless, but the way there is hard.