News for hackers. Stuff that matters.
Re:Google Search Is Now a Giant Hallucination by iLoveOncall on Friday May 24, 2024 @01:36PM (#40468488)
It's actually terrible at parsing natural language. So bad that on a long enough text (or even short if you're unlucky) it will 100% of the time come up with tokens that are not present in the original text.

This sort of rethoric is exactly the same as with crypto "yeah ok it's bad now but think of the future".

Re:Google Search Is Now a Giant Hallucination by infecto on Friday May 24, 2024 @01:40PM (#40468535)
Sorry you have had such bad experiences we won't be able to convince and nobody can see the future but there are exciting things happening at an amazingly short scale.
Re:Google Search Is Now a Giant Hallucination by willsmith72 on Friday May 24, 2024 @01:41PM (#40468556)
strong disagree. what's "long enough" to you?

i can find huge value out of it parsing natural language at even less than 1000 words. their context is way bigger than that already

Re:Google Search Is Now a Giant Hallucination by estebarb on Friday May 24, 2024 @01:55PM (#40468696)
Really? ChatGPT 3.5 and beyond models are fairly capable of understanding PoS and doing text analysis. I have never seen that issue yet with the more advanced models, although smaller/older ones tend to imagine fmthings about the text.

Last year I wrote a paper about using LLMs for definition generation for unknown words based on context, and the models did a fairly good job. https://ieeexplore.ieee.org/abstract/document/10346136/ if someone is curious.

I would like to read prompts where the models are failing in such way. The field is moving quite fast.