News for hackers. Stuff that matters.
Re:Gemini "duck" demo was not done in realtime or with voice by jmathai on Thursday December 07, 2023 @03:21PM (#38561347)
Are you suggesting that failure cases are lower when interacting with humans? I don't think that's my experience at all.

Maybe I've only ever seen terrible doctors but I always cross reference what doctors say with reputable sources like WebMD (which I understand likely contain errors). Sometimes I'll go straight to WebMD.

This isn't a knock on doctors - they're humans and prone to errors. Lawyers, engineers, product managers, teachers too.

Re:Gemini "duck" demo was not done in realtime or with voice by stefan_ on Thursday December 07, 2023 @03:30PM (#38561433)
You think you ask your legal assistant to find some precedents related to your current case and they will come back with an A4 page full of made up cases that sound vaguely related and convincing but are not real? I don't think you understand the failure case at all.
Re:Gemini "duck" demo was not done in realtime or with voice by jmathai on Thursday December 07, 2023 @03:40PM (#38561519)
That example seems a bit hyperbolic. Do you think lawyers who leverage ChatGPT will take the made up cases and present them to a judge without doing some additional research?

What I'm saying is that the tolerance for mistakes is strongly correlated to the value ChatGPT creates. I think both will need to be improved but there's probably more opportunity in creating higher value.

I don't have a horse in the race.

Re:Gemini "duck" demo was not done in realtime or with voice by anon373839 on Thursday December 07, 2023 @04:49PM (#38562289)
> Do you think lawyers who leverage ChatGPT will take the made up cases and present them to a judge without doing some additional research

I really don’t recommend using ChatGPT (even GPT-4) for legal research or analysis. It’s simply terrible at it if you’re examining anything remotely novel. I suspect there is a valuable RAG application to be built for searching and summarizing case law, but the “reasoning” ability and stored knowledge of these models is worse than useless.

Re:Gemini "duck" demo was not done in realtime or with voice by modeless on Thursday December 07, 2023 @03:45PM (#38561581)
> Do you think lawyers who leverage ChatGPT will take the made up cases and present them to a judge without doing some additional research?

I generally agree with you, but it's funny that you use this as an example when it already happened. https://arstechnica.com/tech-policy/2023/06/lawyers-have-rea...

Re:Gemini "duck" demo was not done in realtime or with voice by jmathai on Thursday December 07, 2023 @04:16PM (#38561913)
facepalm
Re:Gemini "duck" demo was not done in realtime or with voice by jazzyjackson on Thursday December 07, 2023 @03:45PM (#38561576)
> Do you think lawyers who leverage ChatGPT will take the made up cases and present them to a judge without doing some additional research?

You don't?

https://fortune.com/2023/06/23/lawyers-fined-filing-chatgpt-...

Re:Gemini "duck" demo was not done in realtime or with voice by freejazz on Thursday December 07, 2023 @03:56PM (#38561714)
What would be the point of a lawyer using chatGPT if it had to root through every single reference chatGPT relied upon? I don't have to doublecheck every reference of a junior attorney, because they actually know what they are doing, and when they don't, it's easy to tell and wont come with fraudulently created decisions/pleadings, etc
Re:Gemini "duck" demo was not done in realtime or with voice by nmfisher on Thursday December 07, 2023 @07:36PM (#38563882)
> Do you think lawyers who leverage ChatGPT will take the made up cases and present them to a judge without doing some additional research?

Oh dear.