News for hackers. Stuff that matters.
Re:Yes, I will judge you for using AI by habinero on Thursday June 26, 2025 @01:37PM (#44389512)
80% is a pretty abysmal success rate and means it's very unreliable.

It sounds nice but it means at least 1 in 5 are bad. That's worse odds than rolling 1 on a d6. You'll be tripping over mistakes constantly.

Re:Yes, I will judge you for using AI by andrekandre on Thursday June 26, 2025 @10:31PM (#44393256)

  > 80% is a pretty abysmal success rate and means it's very unreliable.
EXACTLY. imagine if your car would at best start 80% of the time...
Re:Yes, I will judge you for using AI by bluedel on Friday June 27, 2025 @11:14AM (#44397430)
At least if the car doesn't start, you can immediately tell.
Re:Yes, I will judge you for using AI by yencabulator on Friday June 27, 2025 @11:33AM (#44397594)
Imagine Google Maps driving directions took you in the correct direction 80% of the time.
Re:Yes, I will judge you for using AI by PeterStuer on Sunday June 29, 2025 @08:58AM (#44412765)
From the study: " [80% is] the same level of agreement between humans."

So if 80% is abysmal, you are getting the same abysmal level from human code reviewers.

Re:Yes, I will judge you for using AI by habinero on Monday June 30, 2025 @01:10PM (#44425642)
Not the same thing. With human code reviewers, you can talk to them and resolve conflicts. You can even ask them to review code differently in future.

The whole point of a tool is to reduce workload. If you have to frequently correct it, then it's not worthwhile to use.