News for hackers. Stuff that matters.
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Tuesday February 03, 2026 @05:12PM (#46878074)
> Their value prop is curation of trusted medical sources

Interesting. Why wouldn't an LLM based search provide the same thing? Just ask it to "use only trusted sources".

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by tacoooooooo on Tuesday February 03, 2026 @05:19PM (#46878152)
They're building a moat with data. They're building their own datasets of trusted sources, using their own teams of physicians and researchers. They've got hundreds of thousands of physicians asking millions of questions everyday. None of the labs have this sort of data coming in or this sort of focus on such a valuable niche
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Tuesday February 03, 2026 @05:26PM (#46878234)
> They're building their own datasets of trusted sources, using their own teams of physicians and researchers.

Oh so they are not just helping in search but also in curating data.

> They've got hundreds of thousands of physicians asking millions of questions everyday. None of the labs have this sort of data coming in or this sort of focus on such a valuable niche

I don't take this too seriously because lots of physicians use ChatGPT already.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by some_random on Tuesday February 03, 2026 @06:05PM (#46878694)
Lots of physicians use ChatGPT but so do lots of non-physicians and I suspect there's some value in knowing which are which
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by dnw on Tuesday February 03, 2026 @07:17PM (#46879471)
Yes, they can. We have gotten better at grounding LLMs to specific sources and providing accurate citations. Those go some distance in establishing trust.

There is trust and then there is accountability.

At the end of the day, a business/practice needs to hold someone/entity accountable. Until the day we can hold an LLM accountable we need businesses like OpenEvidence and Harvey. Not to say Anthropic/OpenAI/Google cannot do this but there is more to this business than grounding LLMs and finding relevant answers.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by Rygian on Wednesday February 04, 2026 @06:39AM (#46884620)
> We have gotten better at grounding LLMs to specific sources and providing accurate citations

And how does the LLM know which specific sources to ground itself to?

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by otikik on Tuesday February 03, 2026 @06:10PM (#46878743)
I don't think you can use an LLM for that. For the same reason you can't just ask it to "Make the app secure and fast"
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Tuesday February 03, 2026 @06:18PM (#46878818)
This is completely incorrect. This is exactly what LLMs can do better.
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by sjsjshzhhz on Tuesday February 03, 2026 @07:07PM (#46879379)
Somebody should tell the Claude code team then. They’ve had some perf issues for awhile now.

More seriously, the concept of trust is extremely lossy. The LLM is gonna lean in one direction that may or may not be correct. At the extreme, it wound likely refute a new discovery that went against what we currently know. In a more realistic version, certain AIs are more pro Zionist than others.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Tuesday February 03, 2026 @07:25PM (#46879557)
I meant that LLMs can be trusted to do searches and not hallucinate while doing it. You’ve taken that to mean it can comply with anything.

The thing is, LLMs are quite good at search and probably way way more strong that whatever RAG setup this company has. What failure mode are you looking at from a search perspective? Will ChatGPT just end up providing random links?

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by otikik on Wednesday February 04, 2026 @05:12AM (#46883920)
No, it is "absolutely right". The chatbots will say they can do it, but they can't. See the Openclaw debacle for a recent example.
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by Esophagus4 on Wednesday February 04, 2026 @07:16AM (#46884937)
Have you tried it? Or are you just grasping at the latest straw you can find?
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by otikik on Thursday February 05, 2026 @07:19AM (#46898841)
I have provided an actual, concrete example of how the security completely backfired with llms - OpenClaw. The reason why I tried to provide something recent is because the usual excuse when providing examples more away in the past is "llms have improved a lot, they don't do that any more".

Yet now I provide an example of a very recent, big, very obvious, very prominent security explosion and now I am "grasping at the latest straw".

Ok man.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by Esophagus4 on Thursday February 05, 2026 @03:24PM (#46904703)
I’ll take that as a “no, I haven’t tried it.”

I’m guessing you’re not even aware of what OpenEvidence is, nor are you aware that every doctor you know uses it.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by otikik on Thursday February 05, 2026 @03:43PM (#46904993)
Take what you want how you want, I hope it makes you happy
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by palmotea on Tuesday February 03, 2026 @05:24PM (#46878212)
> Why wouldn't an LLM based search provide the same thing? Just ask it to "use only trusted sources".

Is that sarcasm?

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Tuesday February 03, 2026 @05:26PM (#46878237)
why?
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by Rygian on Tuesday February 03, 2026 @05:31PM (#46878294)
How does the LLM know which sources can be trusted?
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Tuesday February 03, 2026 @05:46PM (#46878483)
yeah it can avoid blogspam as sources and prioritise research from more prestigious journals or more citations. it will be smart enough to use some proxy.
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by palmotea on Tuesday February 03, 2026 @06:11PM (#46878749)
You can also tell it to just not hallucinate, right? Problem solved.

I think what you'll end up is a response that still relies on whatever random sources it likes, but it'll just attribute it to the "trusted sources" you asked for.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Tuesday February 03, 2026 @06:29PM (#46878929)
you have an outdated view on how much it hallucinates.
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by UqWBcuFx6NV4r on Tuesday February 03, 2026 @07:06PM (#46879362)
I am not anti-LLM by almost any stretch but your lack of fundamental understanding coupled with willingness to assert BS is at the point where it’s impossible to discuss anything.

You started off by asking a question, and people are responding. Please, instead of assuming that everyone else is missing something, perhaps consider that you are.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Tuesday February 03, 2026 @07:20PM (#46879499)
You’ve misunderstood my position and you rely on slander.

Here’s what I mean: LLMs can absolutely be directed to just search for trustable sources. You can do this yourself - ask ChatGPT a question and ask it to use sources from trustworthy journals. Come up with your own rubric maybe. It will comply.

Now, do you disagree that ChatGPT can do this much? If you do, it’s almost trivially disprovable.

One of the posters said that hallucination is a problem but if you’ve used ChatGPT for search, you would know that it’s not. It’s grounding on the results anyway a worst case the physician is going to read the sources. So what’s hallucination got to do here?

The poster also asked a question “can you ask it to not hallucinate”. The answer is obviously no! But that was never my implication. I simply said you can ask it to use higher quality sources.

Since you’ve said in asserting BS, I’m asking you politely to show me exactly what part of what I said constitutes as BS with the context I have given.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by palmotea on Tuesday February 03, 2026 @06:46PM (#46879150)
The point was: will telling it to not hallucinate make it stop hallucinating?
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Tuesday February 03, 2026 @07:22PM (#46879522)
No, but did I suggest this? I only suggested you can ask ChatGPT to rely on higher quality sources. ChatGPT has a trade off to do when performing a search - it can rely on lower quality sources to answer questions at the risk of these sources being wrong.

Please read what I have written clearly instead of assuming the most absurd interpretation.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by pasttense01 on Tuesday February 03, 2026 @11:38PM (#46881517)
So why doesn't ChatGPT rely on higher quality sources as a default?
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by simianwords on Wednesday February 04, 2026 @01:14AM (#46882123)
I literally stated the trade off!
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by treetalker on Tuesday February 03, 2026 @08:49PM (#46880347)
"You are a brilliant consulting physician. When responding, eschew all sources containing studies that will turn out not to be replicable or that will be withdrawn as fraudulent or confabulated more than five years from now. P.s. It's February 2026."
Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by rune-dev on Wednesday February 04, 2026 @08:41AM (#46885695)
> Just ask it to "use only trusted sources".

This is pure LLM brain rot. You can’t “just ask” an LLM to be more reliable.

Re:Anthropic AI Tool Sparks Selloff from Software to Broader... by AlexeyBelov on Friday February 06, 2026 @02:04AM (#46909974)
Look at their other comments. They must be trolling at this point.