Re:GPTZero case study discovers it's only accurate on less t...
by howlin on Sunday February 19, 2023 @11:41AM
(#34859127)
> LLMs is the confident hallucination of incorrect facts
This is a very common feature of delirium in people. Chatting with an LLM seems a lot like what it would be to talk to a clever person with encyclopedic knowledge, who is just waking up from anaesthesia or is sleep talking.
Re:GPTZero case study discovers it's only accurate on less t...
by moffkalast on Sunday February 19, 2023 @02:59PM
(#34861226)
Or just the average person on reddit's r/confidentlyincorrect.
Re:GPTZero case study discovers it's only accurate on less t...
by matthewdgreen on Sunday February 19, 2023 @11:26AM
(#34858955)
ChatGPT also thinks certain coding algorithms should violate well-known information-theoretic bounds ;) I’ll put a ticket in with Claude Shannon.
Re:GPTZero case study discovers it's only accurate on less t...
by brookst on Sunday February 19, 2023 @11:32AM
(#34859024)
I’m sure he’ll be excited to learn about this gap!
Re:GPTZero case study discovers it's only accurate on less t...
by xiphias2 on Sunday February 19, 2023 @11:24AM
(#34858923)
Or rather you can just catch method missing in the runtime and patch it with a chatgpt call
Re:GPTZero case study discovers it's only accurate on less t...
by brookst on Sunday February 19, 2023 @11:34AM
(#34859047)
Love it. Get ChatGPT to write the missing method, execute it this once, then store it in a file, update the current source file with the include to cache it for next time.
Re:GPTZero case study discovers it's only accurate on less t...
by int_19h on Sunday February 19, 2023 @06:01PM
(#34862792)
I can't find it, but someone already did a Python module that plugs into GPT-3 and automatically generates functions on the fly as you call them - and then the same for methods on the returned values etc.
Re:GPTZero case study discovers it's only accurate on less t...
by dr_dshiv on Sunday February 19, 2023 @11:58AM
(#34859351)
> it, if ChatGPT thinks the Python list object should have a .is_sorted() property, that’s a pretty good indication that maybe it should.
Yes! And when it hallucinates references for articles, often times those articles probably should exist…
Re:GPTZero case study discovers it's only accurate on less t...
by visarga on Sunday February 19, 2023 @12:39PM
(#34859815)
And if they don't exist, you ask the model to write them from title and link.
Re:GPTZero case study discovers it's only accurate on less t...
by moffkalast on Sunday February 19, 2023 @05:06PM
(#34862336)
The year is 2145.
When a new person is born their entire life is hallucinated in its entirety by the all great and powerful GPT. Deviation from His plan is met with swift and severe consequences.
But the way I see it, if ChatGPT thinks the Python list object should have a .is_sorted() property, that’s a pretty good indication that maybe it should.
I work in PM (giant company, not Python), and one of these days my self-control will fail me and I will open a bug for “product does not support full API as specified by ChatGPT”.