News for hackers. Stuff that matters.
Re:CodeCompose: Meta’s AI Coding Assistant by pavlov on Saturday June 03, 2023 @12:09PM (#36177813)
I think the 8% number better explains why users were so overwhelmingly happy. Assuming the suggestions in general are not distractingly wrong, then 8% of code automatically written is a decent amount of time saved researching solutions.
Re:CodeCompose: Meta’s AI Coding Assistant by layer8 on Saturday June 03, 2023 @02:58PM (#36179504)
But only 22% are accepted for those 8%, which means that the 78% code suggestions that are not accepted correspond to an equivalent of over 28% of all code written. Not sure that having to spend the time evaluating an additional 28% of code in vain amounts to an overall win.

Though I guess the success rates when using Stack Overflow aren’t too dissimilar.

Re:CodeCompose: Meta’s AI Coding Assistant by shostack on Sunday June 04, 2023 @12:01AM (#36182977)
What it doesn't tell us though is how useful the rejected recommendations were.

Meaning, how many rejected solutions were sufficient to give the engineer enough context to turn a 30m task into a 5m task because they generated a recommendation, got an idea, rejected it, and rewrote it more efficiently or more correctly?

There's a lot of "devil in the details" likely buried in here.

Re:CodeCompose: Meta’s AI Coding Assistant by visarga on Saturday June 03, 2023 @03:23PM (#36179713)
Interesting that 91% find it useful but only 8% of the code is generated by LLM. This is even with a LLM tuned on the internal codebase. This will give a mild boost but not replace anyone.