News for hackers. Stuff that matters.
Re:Verification Is Not Knowledge: Science needs more than an... by bmiedlar on Wednesday November 04, 2026 @10:22AM (#50366888)
In a world of short videos, shallow reads, and now quick answers from LLM's it is easy to accept truth without verifying before moving on to the next thing. I was running into similar cases where the confidence was there but the answer was wrong, and as the article suggests, math separates correctness and understanding, so I thought it would be a great area to test where hallucinations still exist in the models. I made a test on large prime numbers where the LLM's couldn't know the answer and we can easily check the factors it produces to verify if it faked it. Nearly 75% of GPT-6 Luna were faked with a false factor when given a hard number with no tools.

There are no comments on this comment yet.