News for hackers. Stuff that matters.
Re:Study mode by ricardobeat on Wednesday July 30, 2025 @02:29AM (#44731390)
This is meaningless without knowing which model, size, version and if they had access to search tools. Results and reliability vary wildly.

In my case I can’t even remember last time Claude 3.7/4 has given me wrong info as it seems very intent on always doing a web search to verify.

Re:Study mode by flir on Wednesday July 30, 2025 @03:52AM (#44731802)
There's something darkly funny about that - I remember when the web wasn't considered reliable either.

There's certainly echoes of that previous furore in this one.

Re:Study mode by fc417fc802 on Wednesday July 30, 2025 @07:17AM (#44732837)
> I remember when the web wasn't considered reliable either.

That changed?

There are certainly reliable resources available via the web but those definitely account for the minority of the content.

Re:Study mode by flir on Wednesday July 30, 2025 @04:53PM (#44739378)
I think it got backgrounded. I'm talking about the first big push, early 90s. I remember lots of handwringing from humanities peeps that boiled down to "but just anyone can write a web page!"

I don't think it changed, I do think people stopped talking about it.

Re:Study mode by otabdeveloper4 on Wednesday July 30, 2025 @09:23AM (#44733878)
> I remember when the web wasn't considered reliable either

It still isn't.

Re:Study mode by commakozzi on Wednesday July 30, 2025 @10:41AM (#44734859)
Yes, it still isn't, we all know that. But we all also know that it was MUCH more unreliable then. Everyone's just being dishonest to try to make a point on this.
Re:Study mode by flir on Wednesday July 30, 2025 @04:55PM (#44739385)
I'm more talking about the conversation around it, rather than its absolute unreliability, so I think they're missing the point a bit.

It's the same as the "never use your real name on the internet" -> facebook transition. Things get normalized. "This too shall pass."

Re:Study mode by SpicyLemonZest on Wednesday July 30, 2025 @10:29AM (#44734723)
The web remains unreliable. It's very useful, so good web users have developed a variety of strategies to extract and verify reliable information from the unreliable substrate, much as good AI users can use modern LLMs to perform a variety of tasks. But I also see a lot of bad web users and bad AI users who can't reliably distinguish between "I saw well written text saying X" and "X is true".
Re:Study mode by ay on Wednesday July 30, 2025 @06:52AM (#44732708)
It was Claude in November 2024, but the “west of equator” is a good enough universal nonsense to illustrate the fundamental issue - just that today it is in much subtler dimensions.

A not-so-subtle example from yesterday: Claude Code claiming to me yesterday assertion Foo was true, right after ingesting the logs with the “assertion Foo: false” in it.