News for hackers. Stuff that matters.
Re:AMD acquires Taalas to boost inference performance by etc... by daishi55 on Thursday August 06, 2026 @06:56PM (#49203770)
> out of 100 random questions I might think to ask, it’s likely to say something wrong or stupid a handful of times at least.

What are some examples?

Re:AMD acquires Taalas to boost inference performance by etc... by wmf on Thursday August 06, 2026 @07:25PM (#49204011)
There's a benchmark for this and a lot of models get negative scores because they're so unreliable: https://artificialanalysis.ai/evaluations/omniscience
Re:AMD acquires Taalas to boost inference performance by etc... by daishi55 on Thursday August 06, 2026 @09:26PM (#49204848)
I wanted some examples they actually experienced. Because I use these things daily and haven’t seen a hallucination in a long long time.
Re:AMD acquires Taalas to boost inference performance by etc... by tyre on Thursday August 06, 2026 @11:59PM (#49205757)
Search a terminal with Claude Code for things like, “I got it wrong twice. I should look up the documentation instead of guessing.”

Does it about once a day, that I notice.

Re:AMD acquires Taalas to boost inference performance by etc... by yoyohello13 on Thursday August 06, 2026 @09:42PM (#49204949)
I saw a hallucination just this afternoon about a spurious ca cert error. Definitely happens less often, but I do need to correct it occasionally. Maybe once a week so it still requires vigilance.
Re:AMD acquires Taalas to boost inference performance by etc... by B-Con on Saturday August 08, 2026 @03:03AM (#49219504)
Not OP but I've tried using all the major frontier models to find niche items in a field that I collect. The models get confused and hallucinate items that sounds complete reasonable, but don't actually exist. Usually it's an amalgamation of several real products.

My prompt is akin to "recommend <item type> with <niche criteria>". The first 3-ish results are about right, and then 7 of the next 10 are hallucinations and the LLM clearly can't throw up its hands and say "I got nothing".

I'm sure this is a hard problem because of a) how many items there are, b) how much overlap there is between product names, descriptions, manufacturers, different versions of the same product, etc, so keeping them distinct in the model's memory is probably hard, and even worse if it is dynamically fetching and summarizing content then it will be very easy to conflate different items, and c) LLMs are known for not working well on the edge cases with few examples.

Re:AMD acquires Taalas to boost inference performance by etc... by msteffen on Friday August 07, 2026 @01:50AM (#49206328)
Well, I wrote my comment after an exchange similar to this, with the linked example chatbot (chatjimmy): https://pastebin.com/uEV7Pm8q

I asked it a slightly tricky math problem (I re-asked it the same problem to create the paste, and it did about as well the second time). It was unable to solve the problem, and it’s a small, old model, so…fair enough…but also its answer was pretty incoherent, with stuff like “Since A is an invariant set, it's always possible to find a cave that the fox cannot be in. Therefore, you can always catch the fox in that cave.” (…catch it…in the cave it can’t be in?).

Then, off the top of my head: Claude somewhat recently generated a Spark Job where the worker timeout was longer than the worker heartbeat, so workers would always inevitably be killed when they didn’t heartbeat within their timeout window. (also…neither option needed to be set?) Before I noticed the problem, I asked Claude why the job was taking so long, and it told me the data set was too large. More recently, there was a blog post by John Scalzi I was having a hard time finding, so I posed the problem to ChatGPT, and it came back with a blog post that didn’t include any version of the text I remembered and wasn’t really topically relevant (and maybe I hallucinated the blog post, but it could’ve said “I can’t find it” instead of “here you go”). On another occasion, I was trying to find a particular episode of Bob the Builder for my kids, so I Googled it, and Gemini kept giving me the wrong season and episode number, even after several rounds of “no, s5e6 is ‘that thing’, I’m looking for ‘this thing’.” Turned out the episode wasn’t on Amazon at all (which I had to tell it), and I had to go find it on YouTube.

That said, as I sit here scrolling through my history to see if I’ve forgotten any particularly good examples, I have to admit they do a better job than I’m giving them credit for. But I still wouldn’t have them write my email for me (the one time I tried that, when I was playing with openclaw, it sent a fairly demanding email to someone I didn’t know that well without asking for confirmation, and I had to go apologize and explain that I hadn’t really written the email, which was embarrassing), nor am I particularly excited to have chatjimmy as a permanent resident of my pocket.