I believe that the current ad revenue model is facing a challenge due to the shift from a search-based approach to a dialogue-based one. People are more likely to use a local model to filter the web and communicate in a Q&A format. This means that fewer ads will be visible, making it more difficult for businesses to generate revenue in this new paradigm. Why search when you can ask directly for the answer?

BTW, local models underperform GPT-3 but they can still perform decently (eg. FLAN T5, GPT Neo)

And you think AI models could not provide answers appropriately biased towards an advertiser? Organic ad content is the future.

No kind of ads will work if your LM is skipping them. I am thinking along the lines of having an OS-LM or a browser-LM, should be a standard component.

You mean the same google that owns DeepMind, one the premiere AI companies on the planet?

OK, that's actually something real impressive they've done!

Didn't think of it. It's not much of a business though. At least not yet.

I suspect that when it becomes a business we might not know about it for a while. Why show your cards if you don’t have to? Their medical research alone seems very promising. Obviously OpenAI has been doing incredible things, but I suspect DeepMind is doing really cool stuff in the background too.