How conceptually could a paid search engine solve the problem of SEO and spam? (Curation seems economically infeasible?)

Is what you're actually proposing ad-free search results? (I'd be willing to pay Google approximately $0.01 per search for this. I suspect this is probably more than they get from anything but the most expensive ads (pharma ads that confused old people will click on).)

What I would really love is a browsing-assistance agent based on something like GPT that can summarize and de-cruft search results for me and show me content extracted from web pages in a standard format without any Javascript.

OTOH, I am a paying ChatGPT Plus user and there are some days where I feel like I get my monthly subscription price's worth in a single day.

In terms of summarization, this study Anyscale just published is interesting - llama2-70b gets within a hairsbreadth of gpt-4/human scores for summarization, so it's conceivable that sometime soon, you might be able to run a local LLM on your browser and get decent results (4-bit quants of llama2-70b currently take about 40GB of memory, you need at least 2 x 24GB or 1 x 48GB GPU to run them at reasonable speeds atm): https://www.anyscale.com/blog/llama-2-is-about-as-factually-...

1. How expensive are these to operate when compared to search engines? If search engines are about as good at information retrieval, but are much cheaper, what does that mean for the future of these services?

2. How good are these systems actually when compared to search engines? I get that for things like code, you can immediately verify results through testing, but GPT was trained on what looks good to humans thanks to HFRL, not necessarily for correctness.

I really wonder what's going to happen with this comparison in the near future. I think there's two possibilities:

1. Running inference on models and keeping the models relevant by introducing new data remains extremely expensive and companies like OpenAI operate at massive losses. Eventually this leads to their products getting worse.

2. Models get cheaper to run and efficient enough to run on mobile hardware without losing much fidelity. OpenAI still might be in trouble in this scenario if "open source" models like Llama2 get popular.

I think in this aspect the difference between GPT vs Google not in level of tech, but because GPT took text from copyright owners and distributes it without their consent and without showing their ads, which is being challenged legally in my understanding.

As far as I can tell, it performs a search and then feeds the full text of the search results to an LLM and present a summary with citations.

I think the review was basically, "I’ve had worse cocktails. I’ll be honest."

So...meh?