Answering Legal Questions with LLMs

Re:Answering Legal Questions with LLMs by zitterbewegung on Monday April 29, 2024 @11:02AM (#40199230)

This service may have been better with a higher context window but with the required accuracy of legal document writing the inaccuracy of the RAG systems are too high.

Also, people have actually used it in practice and it didn’t go that well. So human in the loop systems in practice should have users finding corrections but won’t occur when you release the product.

https://qz.com/chat-gpt-open-ai-legal-cases-1851214411

[ Parent | on HN ]

Re:Answering Legal Questions with LLMs by mediaman on Monday April 29, 2024 @11:46AM (#40199811)

The systems described in the article don’t sound like RAG at all.

RAG systems have a much lower propensity to hallucinate, and generate verifiable citations from the source material.

Though I think they’re better as research aides than “write the final product for me.”

[ Parent | on HN ]