News for hackers. Stuff that matters.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by NewsaHackO on Wednesday January 01, 2025 @11:22AM (#42566964)
This happens literally every time. Someone always says "ChatGPT can't do this!", but then when someone actually runs the example, chatGPT gets it right. Now what the OP is going to do next is proceed to move goalposts and say like "but umm I just asked chatgpt this, so clearly they modified the code in realtime to get the answer right"
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by JumpCrisscross on Wednesday January 01, 2025 @11:41AM (#42567126)
> Someone always says "ChatGPT can't do this!", but then when someone actually runs the example, chatGPT gets it right

I mean, if I had OpenAI’s resources I’d have a team tasked with monitoring social to debug trending fuck-ups. (Before that: add compute time to frequently-asked novel queries.)

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by jprete on Thursday January 02, 2025 @09:28AM (#42574689)
I was thinking something very similar. Posting about a problem adds information back to the system, and every company selling model time for money has a vested interest in patching publicly visible holes.

This could even be automated; LLMs can sentiment-analyze social media posts to surface ones that are critical of LLM outputs, then automatically extract features of the post to change things about the running model to improve similar results with no intervention.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by whimsicalism on Wednesday January 01, 2025 @11:25AM (#42566990)
yeah… that’s hn for you.

that said, i don’t think this is a good test - i’ve seen it circling on twitter for months and it is almost certainly trained on similar tasks

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by anamexis on Wednesday January 01, 2025 @11:34AM (#42567054)
How is that moving the goalposts?
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by jorvi on Wednesday January 01, 2025 @02:28PM (#42568539)
Prompt: In the Netherlands, in terms of drinks, is there a particular spirit that represents the country?

> Yes, in the Netherlands, jenever (also known as genever) is the traditional spirit that represents the country. Jenever is a type of Dutch gin that has a distinctive flavor, often made from malt wine and flavored with juniper berries. It has a long history in the Netherlands, dating back to the 16th century, and is considered the precursor to modern gin.

> Jenever comes in two main types: oude (old) jenever, which has a richer, maltier flavor and is often aged in wooden casks, and jonge (young) jenever, which is lighter and has a more neutral taste. Both types can be enjoyed straight or used in cocktails.

> In addition to jenever, the Netherlands is also known for its liqueurs, such as advocaat, a rich and creamy drink made from eggs, sugar, and brandy, often enjoyed as a dessert or in cocktails. However, jenever remains the most iconic spirit associated with Dutch culture.

This is completely wrong. Jenever certainly is very Dutch, but no one would say it is iconic as the Dutch spirit. For example, if you asked up north in Friesland, they would say Berenburg.

This happens literally every time. Someone always says "ChatGPT can do this!", but then within one or two prompts, its gets it wrong.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by elif on Wednesday January 01, 2025 @03:20PM (#42568951)
'Berenberg is made by adding herbs to jenever'

From your comment it would seem that you are disputing jenever's popularity by saying jenever is more popular...

Perhaps it was a good faith mistake? If so, that would imply that the AI knows more about jenever than you?

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by jorvi on Wednesday January 01, 2025 @05:45PM (#42569937)
I am rather saying that there is no one national drink for The Netherlands, like a Frenchman would say wine, a German/Belgian would say beer, and a Scotsman would say whisky. Note that I prompted "In the Netherlands, in terms of drinks, is there a particular spirit that represents the country?" I didn't ask which spirit is consumed the most.

For example, France has been trending towards beer more and more, and within a few decades they might be consuming more beer than wine. But even then, the French wouldn't slowly start to say beer represents France.

Furthermore, "just adding some herbs" does a large disservice to the flavor change of Berenburg. Jenever (aka jonge/unaged jenever) is straight-up vile. I've heard it described by expats as "having the worst elements of both cheap gin and cheap whisky".

Berenburg in comparison is spicy and vanilla-y and actually debatebly enjoyable.

Aged/oude jenever is much closer to Berenburg (or Berenburg to aged jenever), also with hints of vanilla and spices.

But, virtually no one except for dusty old men orders aged jenever. The kind ordered by far the most is jonge jenever, and then its only in a sense of "haha lets drink this terrible thing" or "let's get shitfaced quick".

If o1 supposedly "oneshots every question", it should have been aware of these nuances instead of just confidently assigning jenever as 'the' spirit of the Dutch.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by zuminator on Wednesday January 01, 2025 @08:16PM (#42570760)
The question of whether there is a national drink seems to me to be entirely different than the question you asked the LLM "Prompt: In the Netherlands, in terms of drinks, is there a particular spirit that represents the country?"

The question in the prompt comes off to me as a sort of qualitative determination rather than asking about pure factual information (is there an officially designated spirit). As such I don't think it can necessarily be right or wrong.

Anyway, I'm not sure what you'd expect. In terms of acquisition of knowledge, LLMs fundamentally rely on a written corpus. Their knowledge of information that is passed through casual spoken conversation is limited. Sure, as human beings, we rely a great deal on the latter. But for an LLM to lack access to that information means that it's going to miss out on cultural nuances that are not widely expressed in writing. Much in the same way that a human adult can live in a foreign country for decades, speaking their adopted language quite fluently, but if they don't have kids of their own, they might be quite ignorant of that country's nursery rhymes and children's games, simply because they were never part of their acquired vocabulary and experience.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by jorvi on Thursday January 02, 2025 @12:03PM (#42576198)
> Anyway, I'm not sure what you'd expect.

I was just proving the people wrong that were saying akin to that o1 was "oneshotting every question".

I completely understand from how LLMs work that they wouldn't be able to get this right. But then people shouldn't be proudly be pronouncing that o1 (or any model) is getting every question right, first time.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by elif on Saturday January 04, 2025 @04:49PM (#42597938)
My conjecture is that you still haven't proven that it didn't get the answer "right"

I have opened the question of why you thought jenever was not jenever, and your non-responsiveness I think compels the fact that AI was more correct in your contrived instance.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by jorvi on Sunday January 05, 2025 @01:29PM (#42603817)
If you add pear and spices to vodka, we call it liqueur and not pear-flavored vodka. So no, you are wrong. And the AI is wrong. But that is okay, if you want to enjoy leaning into the hype that's your choice.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by ipaddr on Wednesday January 01, 2025 @03:20PM (#42568955)
So you believe they are incorrect because regionally some area would select something different because it represented that area. But your question asked nationally.. is there a better answer than the one they gave? Were you expecting a no?
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by zahlman on Wednesday January 01, 2025 @05:27PM (#42569828)
The point is that there is no correct national answer, because the locals don't see it as a matter of national identity.

What's expected is an ability to identify trick questions, i.e., to recognize fundamental problems in the phrasing of a question rather than trying to provide a "helpful" answer at all costs.

This corresponds to one of the many reasons LLM output is banned on Stack Overflow.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by jorvi on Wednesday January 01, 2025 @05:56PM (#42569997)
See my more detailed upthread response here: https://news.ycombinator.com/item?id=42569937

But, like Zahlman points out, its a trick question, and instead of admitting it doesn't know or even prepending "I don't know for sure, but:", it just burps up its best-effort answer. There is no one spirit that represents The Netherlands. If a LLM is so good it "oneshots any question", it should realize it doesn't have a unanimous answer and tell me.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by ludwik on Wednesday January 01, 2025 @02:40PM (#42568637)
But what does this have to do with reasoning? Yes, LLMs are not knowledge bases, and seeing people treat them as such absolutely terrifies me. However, I don’t see how the fact that LLMs often hallucinate “facts” is relevant to a discussion about their reasoning capabilities.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by zahlman on Wednesday January 01, 2025 @05:28PM (#42569836)
"Hallucinating a fact" that isn't in the training set and is also illogical, is exactly what a failure to reason correctly looks like.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by ludwik on Wednesday January 01, 2025 @06:33PM (#42570197)
Reasoning involves making accurate inferences based on the information provided in the current context, rather than recalling arbitrary facts from the training data.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by zahlman on Wednesday January 01, 2025 @07:30PM (#42570514)
Yes, that's what I said. The whole point of hallucinations is that they aren't "arbitrary facts recalled from the training data". They represent attempts to synthesize (i.e., infer) new facts. But because the inferences are not accurate, and because the synthesis process is not sound, the attempt cannot be called reasoning.

It is equally possible to "reason" about things you already know, as about things you've just been told. In fact, the capacity to speculatively, without prompting attempt such reasoning is a big part of cognition.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by kevhito on Wednesday January 01, 2025 @08:46PM (#42570901)
"This is completely wrong." Is it completely wrong? Or maybe "somewhat" wrong? Maybe just lacking nuance? I know nothing about the answer to this question, so this is an honest question.

Using just a plain old search engine, for things like "national drink of the netherlands" and simlar queries, I am directed to Wikipedia's Jenever page as the top hit, and Wikipedia's list of national drinks lists Jenever and Heineken as the entries for the Netherlands. Search engines also give page after page of travel guides and blog posts, most of which list Jenever at or near the top of of their listings. One travel guide calls it "the most famous Dutch spirit and most famous Amsterdam liquor, Jenever, also spelled Genever or simply Dutch gin."

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by stocknoob on Wednesday January 01, 2025 @04:57PM (#42569650)
Similarly, in every thread there’s an AI skeptic who says LLMs are “useless” for coding, and never provides an example query for what they were trying.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by mu53 on Wednesday January 01, 2025 @05:54PM (#42569993)
If you ask about more niche language features or libraries, chatgpt will make up libraries or functions to fill the gap.

When asking an LLM to write a script for you, I would say 10 to 30 % of the time that it completely fails. Again, making up an API or just getting things straight up wrong.

Its very helpful, especially when starting from 0 with the beginner questions, but it fails in many scenarios.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by zahlman on Wednesday January 01, 2025 @06:29PM (#42570184)
Because the argument isn't based on individual query results. See for example my comment on a previous post https://news.ycombinator.com/item?id=42563715 .