News for hackers. Stuff that matters.
Re:Google's First Tensor Processing Unit: Architecture by exitheone on Tuesday March 26, 2024 @03:13AM (#39824974)
The cost per ad is still astronomically different between search ads and LLMs
Re:Google's First Tensor Processing Unit: Architecture by varjag on Tuesday March 26, 2024 @04:40AM (#39825455)
There could be an opposite avenue: ad-free Google Premium subscription with AI chat as a crown jewel. An ultimate opportunity to diversify from ad revenue.
Re:Google's First Tensor Processing Unit: Architecture by disgruntledphd2 on Tuesday March 26, 2024 @09:51AM (#39827817)
There's not enough money in it, as Google's scale.

Especially because the people who'd pay for Premium tend to be the most prized people from an advertiser perspective.

And most people won't pay, under any circumstances, but they will click on ads which make Google money.

Re:Google's First Tensor Processing Unit: Architecture by varjag on Tuesday March 26, 2024 @10:25AM (#39828238)
YouTube does it, at Google scale. And these same people do pay $20/mo for ChatGPT anyway.
Re:Google's First Tensor Processing Unit: Architecture by nemothekid on Tuesday March 26, 2024 @11:20AM (#39829024)
YouTube isn't comparable - YouTube revenue is roughly 30B/year, while Search revenue is roughly 175B/year.

Advertisers are willing to pay far more than $20/mo per user, combined with the fact that search costs way less per query than inference.

Re:Google's First Tensor Processing Unit: Architecture by nequo on Tuesday March 26, 2024 @07:49PM (#39834152)
The low operating margin of serving a GPT-4 scale model sounds like a compelling explanation for why Google stayed out of it.

But then why did Microsoft put its money behind it? Alphabet's revenue is around $300bn, and Microsoft's is around $210bn which is lower but it is the same order of magnitude.