News for hackers. Stuff that matters.
Re:GitHub Copilot Labs by spullara on Wednesday December 01, 2021 @03:04PM (#29408473)
Is this the same backend that is powering https://denigma.app ?
Re:GitHub Copilot Labs by mdaniel on Wednesday December 01, 2021 @04:17PM (#29409245)
Almost certainly not

---

That was also the first time I had heard of denigma.app and their tagline of

We stress-tested it on the worst, most obscure code we could find. That's why we're confident it will work on your complex codebase.

gave me a good chuckle since just trivially modifying their example ... sort of worked

Given:

    RUN apt-get update && exit 1 && apt-get install -y libnss3 libgtk-3-0 libx11-xcb1 libxss1 libasound2
It produced:

- Next, apt-get is used to update the system and exit 1 is used to stop any further commands from running.

- Then libnss3, libgtk-3-0, libx11-xcb1, libxss1, and libasound2 are installed using apt-get.

For good fun, I tried another small edit

    RUN exit 1 && apt-get update && apt-get install -y libnss3 libgtk-3-0 libx11-xcb1 libxss1 libasound2
With an even better explanation:

- The code then runs an exit command and uses apt-get to update its package list before installing libnss3, libgtk-3-0, libx11-xcb1, libxss1, and asound2.

Re:GitHub Copilot Labs by CyberShadow on Wednesday December 01, 2021 @04:23PM (#29409316)
I think having it produce good output on nonsensical / obviously wrong code would be a very different target than explaining commonly found code, so your expectation is a little unreasonable at this point.
Re:GitHub Copilot Labs by mdaniel on Wednesday December 01, 2021 @04:29PM (#29409373)
Well, they're the ones that said "worst" and "most obscure," that wasn't me paraphrasing

But my heartburn is the intersection of these two bullet points: "and exit 1 is used to stop any further commands from running", followed by _any other claim_

> obviously wrong code

Based on my experience with code reviews, I'd bet $5 I could put (or leave) "&& exit 1 &&" in the middle of a sea of RUN commands and it'd go unnoticed. So I guess it depends on who the target audience is for both this and the absolutely laughable Labs output: people who don't want to read what an if statement does, or people looking for the _meaning_ of the code?

Re:GitHub Copilot Labs by Aeolun on Wednesday December 01, 2021 @07:40PM (#29411100)
I think the explanation is just as correct as the code.

Garbage in -> garbage out

Re:GitHub Copilot Labs by codeenlightener on Wednesday December 01, 2021 @05:57PM (#29410243)
Denigma works very poorly on short code– especially single lines. It warns you.

It is designed for explaining real-world code in context, and performs poorly on esoteric examples.

Re:GitHub Copilot Labs by mdaniel on Wednesday December 01, 2021 @06:14PM (#29410375)
In case it wasn't clear, I modified your DevOps example, so it's not like that code came out of left-field or was hand-crafted to trip you up. If you want to say "it is not good at reasoning about shell, instead focusing on programming languages" that'd be a much more plausible concession

Since you're hanging out here, what is the explanation for how it can say "exit 1 is used to stop any further commands from running." and then carry on?

It's even more bizarre that it (seems to?) understands what "exit 1" does, but only when it is not the first command in the sequence?