Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by onion2k on Saturday December 21, 2024 @02:56AM
(#42478138)
I wouldn't be surprised if GPT genuinely makes better decisions than an inexperienced, first-time CEO who has only been a dev before, especially if the person prompting it has actually put some effort into understanding their own weaknesses. It certainly wouldn't be any worse than someone who's only experience is reading a few management books.
[ Parent
| on HN ]
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by lazide on Saturday December 21, 2024 @03:47AM
(#42478316)
And here is a great example of the problem.
An LLM doesn’t make decisions. It generates text that plausibly looks like it made a decision, when prompted with the right text.
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by beardedwizard on Saturday December 21, 2024 @06:39AM
(#42479093)
Why is this distinction lost in every thread on this topic, I don't get it.
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by lazide on Saturday December 21, 2024 @09:02AM
(#42479724)
A lot more people are credulous idiots than anyone wants to believe - and the confusion/misunderstanding is being actively propagated.
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by beardedwizard on Saturday December 21, 2024 @04:21PM
(#42482420)
I think we have to be open to the possibility it's us not them, but I haven't been convinced yet
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by brookst on Sunday December 22, 2024 @02:37AM
(#42484927)
Seeing dissenting opinions as being “actively propagated” by “credulous idiots” sure makes it easy to remain steady in one’s beliefs, I suppose. Not a lot of room to learn, but no discomfort from uncertainty.
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by brookst on Sunday December 22, 2024 @02:35AM
(#42484923)
Because it’s a distinction without a difference. You can say the same thing about people: many/most of our decisions are made before our consciousness is involved. Much of our “decision making” is just post hoc rationalization.
What the “LLMs don’t reason like we humans” crowd is missing is that we humans actually don’t reason as much as we would like to believe[0].
It’s not that LLMs are perfect or rational or flawless… it’s that their gaps in these areas aren’t atypical for humans. Saying “but they don’t truly understand things like we do” betrays a lack of understanding of humans, not LLMs.
0. https://home.csulb.edu/~cwallis/382/readings/482/nisbett%20s...
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by djeastm on Saturday December 21, 2024 @04:04PM
(#42482275)
I think they just mean that GPT produced text that a human then makes a decision using (rather than "GPT making a decision")
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by lazide on Saturday December 21, 2024 @09:13PM
(#42483939)
I wish that was true.
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by onion2k on Monday December 23, 2024 @07:40AM
(#42493985)
Yeah, that's fair. I should have said something like "GPT generates a less biased description of a decision than an inexperienced manager", and that using that description as the basis of an actual decision likely leads to better outcomes.
I don't think there's much of a difference in practise though.
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by sirsinsalot on Saturday December 21, 2024 @07:07AM
(#42479204)
Think of all the human growth and satisfaction being lost to risk mitigation by offloading the pleasure of failure to Machines.