Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

Re:Lawyer cited 6 fake cases made up by ChatGPT; judge calls... by tialaramex on Tuesday May 30, 2023 @07:18PM (#36132477)

A colleague tried 20 questions with ChatGPT and the answer they'd chosen was "Margaret Thatcher" (UK Prime Minister, the "Iron Lady")

ChatGPT got as far as basically narrowing it down to post-War UK Prime Ministers, which is fairly impressive although it only had a few questions left. Then though it decided the answer must be "Winston Churchill". Churchill isn't meaningfully a post-War PM. He lost the July 1945 General Election, which was before the Pacific victory.

It did guess Maggie, with nothing left, at a point where I don't think it had ruled out Blair, Cameron or Heath, let alone say, Liz Truss, but guessing Churchill first shows the limitations of such a model.

[ Parent | on HN ]

Re:Lawyer cited 6 fake cases made up by ChatGPT; judge calls... by abirkill on Tuesday May 30, 2023 @07:40PM (#36132680)

Churchill was also prime minister from 1951-55.

[ Parent | on HN ]

Re:Lawyer cited 6 fake cases made up by ChatGPT; judge calls... by tialaramex on Wednesday May 31, 2023 @02:45AM (#36135249)

Huh, it's probably that simple, I mean it doesn't explain why it thought it had definitely found the answer given there were a bunch more PMs to go, but yeah that does qualify Churchill.

[ Parent | on HN ]