Re:Behind the curtain: what it feels like to work in AI righ...
by jacquesm on Friday April 07, 2023 @02:47AM
(#35478853)
> Most Google queries by volume can be answered from a a cache.
And given how aggressively they limit the number of search results (in spite of listing some ridiculous number of results on page #1) that percentage may well be very large.
There's a scaling problem. ChatGPT/LLM systems cost far more to run per query than the Google search engine. Google can't afford to make those the first line query reply.
A big business model question is whether Google will insist you be logged in to get to the large language model.
At Google scale, these things are going to have to be a hierarchy. Not everything needs to go to a full LLM system. Most Google queries by volume can be answered from a a cache.