News for hackers. Stuff that matters.
Re:Gemini "duck" demo was not done in realtime or with voice by rkeene2 on Friday December 08, 2023 @01:41AM (#38566082)
It's not clear because it is false and I believe I can produce a proof if you are willing to validate that you accept my premise.

Your CPU, right now, has known defects. It will produce the wrong outputs for some inputs. It seems to meet your definition of broken.

Do you agree with that premise ?

Re:Gemini "duck" demo was not done in realtime or with voice by freejazz on Friday December 08, 2023 @12:44PM (#38571798)
One has nothing to do with the other. There's no rule about all broken tools because they can be broken in different ways. What's so difficult about my hypothetical? I laid it all out for you.
Re:Gemini "duck" demo was not done in realtime or with voice by rkeene2 on Friday December 08, 2023 @02:19PM (#38572975)
I assumed you understood we reached the end of the usefulness of your hypothetical to the original analogy since, as you said, the tools can be broken in different ways. I tried to introduce a scenario that was more applicable and less theoretical so that we could discuss those particular points.

If we do somehow try to apply your analogy, it would indicate that the LLM output is flawed in a way we cannot scrutinize -- the hidden failures that we aren't detecting (why? It's not specified, I am assuming because we didn't check to see if the tool was "broken" and not meeting some unspecified quality-level; that is, it's an unknown unknown failure mode).

This doesn't really comport with the LLM scenario, where the output is fully viewed, and the outputs are widely understood (that is it is a known failure mode).

This is more closely related to a computing service -- of which you are an active user of. You are using a "broken" computer right now, according to your definition of broken correct ?

Re:Gemini "duck" demo was not done in realtime or with voice by freejazz on Saturday December 09, 2023 @12:59PM (#38584030)
>This doesn't really comport with the LLM scenario, where the output is fully viewed, and the outputs are widely understood (that is it is a known failure mode).

Yes, it does. People are regularly using LLMs to brief themselves on topics they are ignorant about. Are you actually serious?

>This is more closely related to a computing service -- of which you are an active user of. You are using a "broken" computer right now, according to your definition of broken correct ?

Doesn't really matter, because I'm not relying upon the computer for the verity of its functions