Re:Any insider takes on Yann LeCun's push against current ar...
by QuesnayJr on Saturday March 15, 2025 @01:03AM
(#43370113)
I tried this just now on Chatbot Arena, and both chatbots asked for more information.
One was GPT 4.5 preview, and one was cohort-chowder (which is someone's idea of a cute code name, I assume).
Re:Any insider takes on Yann LeCun's push against current ar...
by wavemode on Saturday March 15, 2025 @01:42AM
(#43370276)
I tried this just now on Chatbot Arena, and both chatbots very confidently got the name of the park wrong.
Perhaps you thought I meant "1st and 2nd" literally? I was just using those as an example so I don't reveal where I live. You should use actual street names that are near a public park, and you can feel free to specify the city and state.
Re:Any insider takes on Yann LeCun's push against current ar...
by QuesnayJr on Saturday March 15, 2025 @02:06AM
(#43370359)
I did think you meant it literally. Since I can't replicate the question you asked, I have no way of verifying your claim.
But if you ask it in terms of a knowledge test ("I'm at the corner of 1st and 2nd, what public park am I standing next to?") a model lacking web search capabilities will confidently hallucinate (unless it's a well-known park).
In fact, my person opinion is that, therein lies the most realistic way to reduce hallucination rates: rather than trying to train models to say "I don't know" (which is not really a trainable thing - models are fundamentally unaware of the limits of their own training data), instead just train them on which kinds of questions warrant a web search and which ones should be answered creatively.