News for hackers. Stuff that matters.

Tell HN: AI legal contract review is already screwing up

Sample Size of 1...

I had lunch with a lawyer friend today, who told me that their morning was surreal. At their meeting to go over the latest contract draft, the client introduced new AI software they had purchased (who is selling this???) and its list of recommended changes.

Every single recommendation was worse for the client, and after explaining the reasons, the call lasted longer than it normally would have, so the bill to the client was higher. The lawyer asked if AI was really that stupid, or if their contracts were really that amazing, because then they should be charging a lot more for them.

( 11 comments | 4 points | on HN )
Re:Tell HN: AI legal contract review is already screwing up by brucethemoose2 on Wednesday June 21, 2023 @03:21PM (#36423082)
> who is selling this???

I would bet money the software is querying GPT4 with a prompt like "Please analyze the contract below and recommend improvements..." Then they turn around and market it enough to make a crypto company blush.

Maybe a very thorough finetune on a massive legal corpus from your jurisdiction, hooked up to a good database, would make something interesting. But I doubt anyone has done this so quickly.

Re:Tell HN: AI legal contract review is already screwing up by newprint on Wednesday June 21, 2023 @03:06PM (#36422897)
I read twice what you wrote and I still don't understand what is going. Who did what ?
Re:Tell HN: AI legal contract review is already screwing up by Kon-Peki on Wednesday June 21, 2023 @03:24PM (#36423112)
Company A hires lawyer to write a contract between Company A and Company B.

Company A runs contract through AI software, which recommends changes.

Lawyer spends a lot of time explaining to Company A that the recommended changes are beneficial to Company B and detrimental to Company A, and charges $X for every 6 minutes of explanation time.

Re:Tell HN: AI legal contract review is already screwing up by newprint on Wednesday June 21, 2023 @03:38PM (#36423286)
Lol, this is funny. Thank you for clarification. Lawyers win either way.
Re:Tell HN: AI legal contract review is already screwing up by Kon-Peki on Wednesday June 21, 2023 @04:04PM (#36423626)
You know, it just hit me: either side can file a lawsuit over a contract. So "plaintiff" and "defense" are not deterministic in terms of who wrote the contract and who agreed to it. How can an AI that is trained only on court transcripts make any inferences on what is good for which party?
Re:Tell HN: AI legal contract review is already screwing up by nathan_tarbert on Wednesday June 21, 2023 @03:14PM (#36422996)
I'm not sure if I understand this completely either...
Re:Tell HN: AI legal contract review is already screwing up by rvz on Wednesday June 21, 2023 @03:34PM (#36423241)
TLDR: AI snake oil software pretending to be a lawyer wasted more time and money after hallucinating worse recommendations for the client which a human could have done without it.
Re:Tell HN: AI legal contract review is already screwing up by anconia on Wednesday June 21, 2023 @04:07PM (#36423663)
What was the AI software?
Re:Tell HN: AI legal contract review is already screwing up by mikeross321 on Thursday June 22, 2023 @11:02PM (#36442311)
Probably Harvey
Re:Tell HN: AI legal contract review is already screwing up by roomannj on Wednesday June 21, 2023 @04:08PM (#36423671)
Well. Reading legal contracts is definitely brain burning. I have talked to lawyers about the AI contract summary idea as well. Probably you want to start with some standard simple contract targeting individual customers first.
Re:Tell HN: AI legal contract review is already screwing up by b20000 on Thursday June 22, 2023 @12:23AM (#36427988)
the same goes for copilot and other code assistants in the end, it will be more expensive to use AI copilots for writing code instead of just writing the code. it's still early on and people will take a while to catch up.