News for hackers. Stuff that matters.

A comment on GPT-4 gets a B on my quantum computing final exam. Parent comment

Re:GPT-4 gets a B on my quantum computing final exam by umvi on Tuesday April 11, 2023 @03:51PM (#35530549)
> So humans still have to check the output, and now we’re in that situation where humans driving a Tesla on autopilot who are supposed to be 100% aware of the road aren’t, because they get lazy and doze off, and now the car crashes and whoops.

The only question is whether, on average, AI-augmented code suggestions reduce overall bug rates. Human devs are already dozing off with crashes and whoopsies at high rates so it doesn't matter too much if AI output has a bug or whoopsie so long as they occur at rates lower than pure human generated code.

[ Parent | on HN ]
Re:GPT-4 gets a B on my quantum computing final exam by __MatrixMan__ on Tuesday April 11, 2023 @04:08PM (#35530784)
I don't think it's as simple as a mere bug rate comparison. When a human makes a whoopsie, we blame that human. Maybe it's a bit uncomfortable, but it it works to prevent them from cooperating with attempts to inject whoopsies into their code.

If we create a culture of tolerating fatal AI hallucinations as long as they happen at a rate that's below the human caused fatality baseline, we create an opportunity for bad actors to use the "nobody is to blame" window as a plausible deniability weapon (so long as they don't use it too often).

[ Parent | on HN ]