News for hackers. Stuff that matters.
Re:Google's AI answers reducing search traffic by 40% by oblio on Wednesday November 18, 2026 @12:19AM (#50542172)
Yeah, just like everyone hosts their email server. Techies are hopelessly optimistic.
Re:Google's AI answers reducing search traffic by 40% by CamperBob2 on Wednesday November 18, 2026 @12:51AM (#50542351)
As an individual user, there is no reason on God's green earth to host your own email server. (No. Sorry. There's not.)

There are multiple very good reasons to host your own AI models. Those reasons are not going away with time, but rather multiplying.

Re:Google's AI answers reducing search traffic by 40% by oblio on Wednesday November 18, 2026 @01:03AM (#50542419)
It's not about "reasons to host".

It's about capability:

1. Do you have the right hardware? Most people don't and hardware has just exploded in price. One of the RAM makers and also AMD have said they will focus on data centers, which will only make things worse.

2. Do you have the know-how? It needs to be as easy as installing and using Chrome.

3. The end result needs to be directly as usable as ChatGPT.

Fairly local LLMs fail all 3 points.

Re:Google's AI answers reducing search traffic by 40% by no-name-here on Wednesday November 18, 2026 @01:04AM (#50542423)
Cloud-hosted remains more efficient in terms of electricity, RAM use for large GB models, etc.

However, Apple is already including LLM models automatically with even iOS that can be queried for historical facts, etc.

Re:Google's AI answers reducing search traffic by 40% by oblio on Wednesday November 18, 2026 @04:27AM (#50543973)
I'm half optimistic about this, but we're so far from it from a hardware point of view.

We need unified memory for almost everything for these types of setups to be usable and we also need to standardize LLMs, if everyone wants to run their own LLM locally, that will probably be untenable for decades. We probably need new DRAM tech (3D RAM?).

Hardware prices need to go down a lot, and we're probably 5+ years away from that. Not only do prices need to go back to where they were, they need to become even lower. So we're probably 10+ years away from usable good enough local LLMs for the masses.

It's going to be an ugly decade from a hardware economics point of view. The potential is endless, but the way there is hard.