News for hackers. Stuff that matters.

A comment on 62% of code generated by GPT-4 contains API misuses. Parent comment

Re:62% of code generated by GPT-4 contains API misuses by __loam on Monday August 28, 2023 @05:35AM (#37291712)
> It's not a big assumption. It's the most reasonable assumption. When you drive 50% of 10 miles the next 50% takes the same amount of time. It's the default assumption.

And it's wrong, as anyone with experience in ML will tell you. 60% is easy. 70-85% is not too bad. 95% is hard. 100% is effectively impossible. This is the core problem of ML systems. They're good enough for 90% of cases but that last 10% can be incredibly important, to the point that the systems become unusable.

[ Parent | on HN ]
Re:62% of code generated by GPT-4 contains API misuses by corethree on Monday August 28, 2023 @11:11AM (#37295362)
The topic at hand is the pace of AI technology. This one is hard to quantify as it's been mostly linear in terms of technological progress. Example: From gans to LLMs. That progress has not been diminishing.

You seem to think the topic is about the current state of training algorithms and how it's hard to bring the model to 100 percent. That's a different topic with a subtle distinction.

[ Parent | on HN ]