Re:Modern-Day Oracles or Bullshit Machines
by daveguy on Monday February 10, 2025 @11:19PM
(#43008922)
> I ask the question, what is 2 * 2, which is an obviously loaded question that's pattern matched to death.
Yeah, that was my point. Small codomain -> easy to validate. Large codomain -> open to interpretation. You implied that to prove reasoning, pick a prompt with a large codomain and if the LLM answers with accurate precision, then viola, reasoning.
So my question was, can you give an example of a prompt with a high codomain that isn't subject to wide interpretation? It seems the wider the codomain the easier it is to say, "look! reasoning!"
Re:Modern-Day Oracles or Bullshit Machines
by ninetyninenine on Tuesday February 11, 2025 @06:40AM
(#43011682)
Pick a prompt with a wide codomain but a single answer. That’s reasoning if it can get the answer right.
Re:Modern-Day Oracles or Bullshit Machines
by daveguy on Tuesday February 11, 2025 @07:01AM
(#43011832)
Your original claim was that an LLM can reason. And you say it can be proven by picking one of these prompts with a large codomain that has a precise answer which requires reason. If an LLM can come to a specific answer out of a huge codomain, and that answer requires reason, you claim that proves reasoning. Do I have that right?
So my question is, and has been these three replies: Can you give any example of one of these prompts?
Re:Modern-Day Oracles or Bullshit Machines
by ninetyninenine on Tuesday February 11, 2025 @08:16AM
(#43012393)
I ask the question, what is 2 * 2, which is an obviously loaded question that's pattern matched to death.
The LLM can answer "4" or "The answer is 4" of "looks like the answer is 4"
All valid answers but all the same. We count all 3 of those answers as just 4 out of the set of numbers. But we have to use our own language faculties to cut through the noise of the language itself.