CodeCompose: Meta’s AI Coding Assistant

Re:CodeCompose: Meta’s AI Coding Assistant by layer8 on Saturday June 03, 2023 @02:58PM (#36179504)

But only 22% are accepted for those 8%, which means that the 78% code suggestions that are not accepted correspond to an equivalent of over 28% of all code written. Not sure that having to spend the time evaluating an additional 28% of code in vain amounts to an overall win.

Though I guess the success rates when using Stack Overflow aren’t too dissimilar.

[ Parent | on HN ]

Re:CodeCompose: Meta’s AI Coding Assistant by shostack on Sunday June 04, 2023 @12:01AM (#36182977)

What it doesn't tell us though is how useful the rejected recommendations were.

Meaning, how many rejected solutions were sufficient to give the engineer enough context to turn a 30m task into a 5m task because they generated a recommendation, got an idea, rejected it, and rewrote it more efficiently or more correctly?

There's a lot of "devil in the details" likely buried in here.

[ Parent | on HN ]