News for hackers. Stuff that matters.
Re:Deep Research by scarab92 on Sunday February 02, 2025 @08:02PM (#42913713)
Think of it like a vaccine.

The majority of consultant reports are complete rubbish. Low signal-to-noise, quantity-over-quality, low accuracy slop.

LLMs are innoculating people to this kind of low information value content.

People who produce LLM quality output, are now being accused of using LLMs, and can no longer pretend to be adding value.

The result of this is going to be higher quality expectations from consultants and a shaking out of people who produce word vommit rather than accurate, insightful, contextually relevent information.

Re:Deep Research by layer8 on Sunday February 02, 2025 @08:24PM (#42913886)
This has been downvoted, but I think there’s actually a chance it might become true (until AGI comes along at least).
Re:Deep Research by DrSiemer on Monday February 03, 2025 @02:47AM (#42915909)
Exactly what will happen with art. The tolerance for low quality output will decrease.
Re:Deep Research by randcraw on Monday February 03, 2025 @12:41PM (#42920728)
I don't think so. Instead of SEO, I think we'll soon see 'LLMO' dominating such uses, where LLM summaries are reshaped by vendors and etailers to misrepresent facts in ways that favor them over others.

I suspect this can be done simply by poisoning a query with supplemental suggestions of sources to use in a RAG, many of which don't even have to be publicly available but are made accessible to the LLM (perhaps by submitting hidden URLs that mislead the summary along with the query).

But even after such a practice is uncovered and roundly maligned, that won't stop the infinite supply of net con men from continuing to inject their poisons into the background that drives deep research, so long as the LLM maker doesn't actively oppose this practice actively and publicly -- which none of them have been willing to do with any other LLM operational details so far.

In fact, I predict that if a LLM summary like DR's does NOT soon provide references to the sources of the facts it relies on, in no time users will disregard such summaries to be yet more uselessly unreliable pfaff from yet another net disreputable -- as we do with search engine summaries now.