Re:Lawyers who cited fake cases hallucinated by ChatGPT must...
by rvz on Friday June 23, 2023 @10:46AM
(#36447522)
> "The lesson here is that you can't delegate to a machine the things for which a lawyer is responsible," said Stephen Wu
Just shows that hallucinating AI snake oil as a service producing unchecked bullshit is indeed useless for very high risk industries like I said before. [0] In this case, it is even worse, since these legal experts already checked it and accepted the output.
So it looks like you still need humans to do even more checking, given the high likelihood of LLMs like ChatGPT hallucinating all over the place.
Just shows that hallucinating AI snake oil as a service producing unchecked bullshit is indeed useless for very high risk industries like I said before. [0] In this case, it is even worse, since these legal experts already checked it and accepted the output.
So it looks like you still need humans to do even more checking, given the high likelihood of LLMs like ChatGPT hallucinating all over the place.
Absolutely unsurprising. [0]
[0] https://news.ycombinator.com/item?id=36091468