> if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?
I think they need to solve hallucination problem first, they are already working on optimization eg FLAN-T5 (smaller LLM models same performance) and RETRO (retrieval transformer that can use data index outside of the model) that takes them closer to use it in search.
Apparently you can avoid hallucination by basically reading the model’s mind instead of asking it questions.
https://arxiv.org/abs/2212.03827
Raises some ethical issues…
To add to your comment, Google has been using BERT to power Search since 2019: https://blog.google/products/search/search-language-understa...
I'm going to guess that the only reason they don't use larger models is because of the compute cost. ChatGPT at 4 billion users with today's hardware is an unsustainable business. However, that thought leads me to imagining: if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?