News for hackers. Stuff that matters.
Re:Gemini "duck" demo was not done in realtime or with voice by dylan604 on Thursday December 07, 2023 @03:28PM (#38561404)
> I'm unsure where this expectation of 100% absolute correctness comes from.

It's a computer. That's why. Change the concept slightly: would you use a calculator if you had to wonder if the answer was correct or maybe it just made it up? Most people feel the same way about any computer based anything. I personally feel these inaccuracies/hallucinations/whatevs are only allowing them to be one rung up from practical jokes. Like I honestly feel the devs are fucking with us.

Re:Gemini "duck" demo was not done in realtime or with voice by bostonpete on Thursday December 07, 2023 @03:38PM (#38561498)
Speech to text is often wrong too. So is autocorrect. And object detection. Computers don't have to be 100% correct in order to be useful, as long as we don't put too much faith in them.
Re:Gemini "duck" demo was not done in realtime or with voice by clumpthump on Thursday December 07, 2023 @03:59PM (#38561739)
Call me old fashioned, but I would absolutely like to see autocorrect turned off in many contexts. I much prefer to read messages with 30% more transparent errors rather than any increase in opaque errors. I can tell what someone meant if I see "elephent in the room", but not "element in the room" (not an actual example, autocorrect would likely get that one right).
Re:Gemini "duck" demo was not done in realtime or with voice by dylan604 on Thursday December 07, 2023 @03:45PM (#38561579)
Your caveat is not the norm though, as everyone is putting a lot of faith in them. So, that's part of the problem. I've talked with people that aren't developers, but they are otherwise smart individuals that have absolutely not considered that the info is not correct. The readers here are a bit too close to the subject, and sometimes I think it is easy to forget that the vast majority of the population do not truly understand what is happening.
Re:Gemini "duck" demo was not done in realtime or with voice by dr_dshiv on Thursday December 07, 2023 @04:26PM (#38562029)
Nah, I don’t think anything has the potential to build critical thinking like LLMs en masse. I only worry that they will get better. It’s when they are 99.9% correct we should worry.
Re:Gemini "duck" demo was not done in realtime or with voice by llbeansandrice on Thursday December 07, 2023 @04:17PM (#38561935)
People put too much faith in conspiracy theories they find on YT, TikTok, FB, Twitter, etc. What you're claiming is already not the norm. People already put too much faith into all kinds of things.
Re:Gemini "duck" demo was not done in realtime or with voice by kamikaz1k on Thursday December 07, 2023 @03:39PM (#38561507)
Okay, but search is done on a computer, and like the person you’re replying to said, we accept close enough.

I don’t necessarily disagree with your interpretation, but there’s a revealed preference thing going on.

The number of non-tech ppl I’ve heard directly reference ChatGPT now is absolutely shocking.

Re:Gemini "duck" demo was not done in realtime or with voice by bitvoid on Thursday December 07, 2023 @03:50PM (#38561642)
> The number of non-tech ppl I've heard directly reference ChatGPT now is absolutely shocking.

The problem is that a lot of those people will take ChatGPT output at face value. They are wholly unaware that of its inaccuracies or that it hallucinates. I've seen it too many times in the relatively short amount of time that ChatGPT has been around.

Re:Gemini "duck" demo was not done in realtime or with voice by bongodongobob on Thursday December 07, 2023 @03:59PM (#38561748)
So what? People do this with Facebook news too. That's a people problem, not an LLM problem.
Re:Gemini "duck" demo was not done in realtime or with voice by dylan604 on Thursday December 07, 2023 @04:10PM (#38561856)
People on social media are absolutely 100% posting things deliberately to fuck with people. They are actively seeking to confuse people, cause chaos, divisiveness, and other ill intended purposes. Unless you're saying that the LLM developers are actively doing the same thing, I don't think comparing what people find on the socials vs getting back as a response from a chatBot is a logical comparison at all
Re:Gemini "duck" demo was not done in realtime or with voice by zozbot234 on Thursday December 07, 2023 @04:37PM (#38562150)
How is that any different from what these AI chatbots are doing? They make stuff up that they predict will be rewarded highly by humans who look at it. This is exactly what leads to truisms like "rubber duckies are made of a material that floats over water" - which looks like it should be correct, even though it's wrong. It really is no different from Facebook memes that are devised to get a rise out of people and be widely shared.
Re:Gemini "duck" demo was not done in realtime or with voice by dylan604 on Thursday December 07, 2023 @04:50PM (#38562301)
Because we shouldn't be striving to make mediocrity. We should be striving to build better. Unless the devs of the bots are wanting to have a bot built on trying to deceive people, I just don't see the purpose of this. If we can "train" a bot and fine tune it, we should be fine tuning truth and telling it what absolutely is bullshit.

To avoid the darker topics to keep the conversation on the rails, if there were a misinformation campaign that was trying to state that the Earth's sky is red, then the fine tuning should be able to inform that this is clearly fake so when quoting this it should be stated as incorrect information that is out there. This kind of development should be how we can clean up the fake, but nope, we're seemingly quite happy at accepting it. At least that's how your question comes off to me.

Re:Gemini "duck" demo was not done in realtime or with voice by zozbot234 on Thursday December 07, 2023 @04:58PM (#38562388)
Sure, but current AI bots are just following the human feedback they get. If the feedback is naïve enough to score the factoid about rubber duckys as correct, guess what, that's the kind of thing these AI's will target. You can try to address this by prompting them with requests like "do you think this answer is correct and ethical? Think through this step by step" ('reinforcement learning from AI feedback') but that's very ad hoc and uncertain - ultimately, the humans in the loop call the shots.
Re:Gemini "duck" demo was not done in realtime or with voice by dylan604 on Friday December 08, 2023 @02:18AM (#38566264)
At the end of the day, if there is no definitive answer to a question, it should respond in such a manner. "While there are compelling reasons to think A or B, neither A nor B have been verified. They are just the leading theories." That would be a much better answer than "Option A is the answer even if some people think B is." when A is just as unproven as B, but because it answers so definitively, people think it is the right answer.

So the labels thing is something that obviously will never work. But the system has all of the information it needs to know if the question is definitively answerable. If it is not, do not phrase the response definitively. At this point, I'd be happy if it responded to "Is 1+1 = 2?" with a wish washy answer like, "Most people would agree that 1+1 = 2", and if it wanted to say "in base 10, that is the correct answer. however, in base 2, the 1+1 = 10" would also be acceptable. Fake it till you make it is not the solution here.

Re:Gemini "duck" demo was not done in realtime or with voice by p1esk on Thursday December 07, 2023 @04:56PM (#38562362)
There are far more people who post obviously wrong, confusing and dangerous things online with total conviction. There are people who seriously believe Earth is flat, for example.
Re:Gemini "duck" demo was not done in realtime or with voice by lm28469 on Thursday December 07, 2023 @04:50PM (#38562300)
Literally everything is a "people problem"

You can kill people with a fork, it doesn't mean you should legally be allowed to own a nuclear bomb "because it's just the same". The problem always come from scale and accessibility

Re:Gemini "duck" demo was not done in realtime or with voice by janalsncm on Thursday December 07, 2023 @04:07PM (#38561830)
If we rewind a little bit to the mid to late 2010s, filter bubbles, recommendation systems and unreliable news being spread on social media was a big problem. It was a simpler time, but we never really solved the problem. Point is, I don’t see the existence of other problems as an excuse for LLM hallucination, and writing it off as a “people problem” really undersells how hard it is to solve people problems.
Re:Gemini "duck" demo was not done in realtime or with voice by umvi on Thursday December 07, 2023 @04:26PM (#38562033)
So you're saying we need a Ministry of Truth to protect people from themselves? This is the same argument used to suppress "harmful" speech on any medium.
Re:Gemini "duck" demo was not done in realtime or with voice by dylan604 on Thursday December 07, 2023 @04:41PM (#38562183)
I've gotten to the point where I want "advertisment" stamped on anything that is, and I'm getting to the point I want "fiction" stamped on anything that is. I have no problem with fiction existing. It can be quite fun. People trying to pass fiction as fact is a problem though. Trying to force a "fact" stamp would be problematic though, so I'd rather label everything else.

How to enforce it is the real sticky wicket though, so it's only something best discussed at places like this or while sitting around chatting while consuming

Re:Gemini "duck" demo was not done in realtime or with voice by umvi on Thursday December 07, 2023 @06:44PM (#38563394)
And who gets to control the "fiction" stamp? Especially for hot button topics like covid (back in 2020)? Should asking an LLM about lab leak theory be auto-stamped with "fiction" since it's not proven? But then what if it's proven later?
Re:Gemini "duck" demo was not done in realtime or with voice by jen20 on Thursday December 07, 2023 @04:35PM (#38562125)
"Computer says no" is not a meme for no reason.
Re:Gemini "duck" demo was not done in realtime or with voice by altruios on Thursday December 07, 2023 @05:06PM (#38562483)
why should all computing be deterministic?

let me show you this "genius"/"wrong-thinking" person as to say about AL(artificial life) and deterministic computing.

https://www.cs.unm.edu/~ackley/

https://www.youtube.com/user/DaveAckley

To sum up a bunch of their content: You can make intractable problems solvable/crunchable if you allow just a little error into the result (which is reduced the longer the calculation calculates). And this is acceptable for a number of use cases where initial accuracy is less important that instant feedback.

It is radically different from a Von Neumann model of a computer - where there is a deterministic 'totalitarian finger pointer' pointing to some registry (and only one registry at a time) is an inherently limited factor. In this model - each computational resource (a unit of ram, and a processing unit) fights for and coordinates reality with it's neighbors without any central coordination.

Really interesting stuff. still in its infancy...