If a tool is broken, you seek to fix it. You don't just say "ah yeah it's a broken tool, but it's better than nothing!"
All these LLM releases are amazing pieces of technology and the progress lately is incredible. But don't rag on people critiquing it, how else will it get better? Certainly not by accepting its failings and overlooking them.
Is a drug “broken” because it only cures a disease 80% of the time?
The framing most critics seem to have is “it must be perfect”.
It’s ok though, their negativity just means they’ll miss out on using a transformative technology. No skin off the rest of us.
Overpowered LLMs like GPT-4 are both broken (according to how you are defining it) and useful -- they're just not the idealized version of the tool.
I don't know why "critiquing the tool" is being equated to "refusing to use the tool."
I don't like calling something a strawman, because I think it's an overused argument, but...I mean...
My point is that the attempt to critique it was a failure. It provided no critique.
It was incomplete at the very least -- it assigned it the label of broken, but didn't explain the implications of that. It didn't define at what level of failure it would need to be to valuable.
Additionally, I didn't indicate whether or not he would refuse to use it -- specifically because I didn't know, because he didn't say.
We all use broken tools built on a fragile foundation of imperfect precision.
If I don't use it, then the tool is not used and provided no benefit...
Your CPU, right now, has known defects. It will produce the wrong outputs for some inputs. It seems to meet your definition of broken.
Do you agree with that premise ?
If we do somehow try to apply your analogy, it would indicate that the LLM output is flawed in a way we cannot scrutinize -- the hidden failures that we aren't detecting (why? It's not specified, I am assuming because we didn't check to see if the tool was "broken" and not meeting some unspecified quality-level; that is, it's an unknown unknown failure mode).
This doesn't really comport with the LLM scenario, where the output is fully viewed, and the outputs are widely understood (that is it is a known failure mode).
This is more closely related to a computing service -- of which you are an active user of. You are using a "broken" computer right now, according to your definition of broken correct ?
Yes, it does. People are regularly using LLMs to brief themselves on topics they are ignorant about. Are you actually serious?
>This is more closely related to a computing service -- of which you are an active user of. You are using a "broken" computer right now, according to your definition of broken correct ?
Doesn't really matter, because I'm not relying upon the computer for the verity of its functions
I think the folks making these tools tend to oversell their capabilities because they want us to imagine the applications we can come up with for them. They aren’t selling the tool, they are selling the ability to make tools based on their platform, which means they need to be speculative about the types of things their platform might enable.
They might have been trained/prompted with misinformation, but then it's the people doing the training/prompting who are lying, still not the LLM.
Perhaps some humans never lie, but should the LLM be trained only on that tiny slice of people? It's part of life, even non-human life! Evolution works based on things lying: natural camouflage, for example. Do octopuses and chameleons "lie" when they change color to fake out predators? They have intent to deceive!
I think this is a different usage of the word, and we're pretty used to making the distinction, but it gets confusing with LLMs.
The model consistently and purposefully withheld knowledge it was directly aware of. This is lying under any useful definition of the word. You're veering off into meaningless philosophy that has no bearing on outcomes and results.
The ones that do are people I do my best to avoid interacting with.
LLMs act more like the latter, than the former.