News for hackers. Stuff that matters.

Ask HN: Is anyone using GitHub Copilot in production?

I'm piloting Copilot as part of an internal trial at my company, and I'm wondering if anyone is actually using Copilot in production or if it's hype driven by non coders. From my testing in Swift, it's certainly able to "write code", but the code it tries to generate is almost always incorrect. It definitely seems like more of a hijacker than a copilot—is this just because of the language I'm using (Swift)? Or is anyone actually writing better code faster?
( 11 comments | 3 points | on HN )
Re:Ask HN: Is anyone using GitHub Copilot in production? by fullstick on Tuesday December 12, 2023 @12:56PM (#38615773)
I use it at work for production code. I've found it very helpful for typescript. Also very handy for writing tests.
Re:Ask HN: Is anyone using GitHub Copilot in production? by ctoth on Tuesday December 12, 2023 @11:12AM (#38614121)
Lots of luck with Typescript and Python, far less with obscure languages like LambdaMOO :)
Re:Ask HN: Is anyone using GitHub Copilot in production? by highhedgehog on Thursday December 14, 2023 @03:25AM (#38639075)
Thank god that is my stack :D
Re:Ask HN: Is anyone using GitHub Copilot in production? by muzani on Tuesday December 12, 2023 @10:47PM (#38622383)
Yeah, our Swift team don't use it. How are you using it? Copilot doesn't seem supported by Xcode. It has the most features on VS Code.

It does an excellent job on Kotlin, especially tests. We find it's most fluent with Python, pretty good with JS and TS, but found several security mistakes on PHP, etc.

For boilerplate, accuracy seems a little higher than human. It wrote 1000 lines of mocks & test code in a day for me. But creatively, it's worse, there's some hallucination.

There's a marked increase in quality and accuracy in GPT-4. GPT-4 is high quality enough that it catches tons of mistakes in code reviews and can debug with a screenshot of a stacktrace. Copilot seems like it's a generation or two out of date.

Re:Ask HN: Is anyone using GitHub Copilot in production? by elpakal on Thursday December 14, 2023 @10:54AM (#38642685)
I added it to JetBrains’ CLion, which I use to write my pure Swift projects.
Re:Ask HN: Is anyone using GitHub Copilot in production? by cpach on Wednesday December 13, 2023 @04:19AM (#38624691)
I don’t use it, but I’m certain it has a quite large user base.

Even if they would have only 1% of all developers world-wide (for example), that’s still a lot of users.

Re:Ask HN: Is anyone using GitHub Copilot in production? by kojeovo on Wednesday December 13, 2023 @09:27AM (#38627812)
I've been shipping code to production that it generates for months now. It's really good for some things. But yeah a lot of the time it's wrong.
Re:Ask HN: Is anyone using GitHub Copilot in production? by solardev on Wednesday December 13, 2023 @11:27AM (#38629700)
I tried it for a couple months (Typescript) in production. It was about 80% accurate, and useful for some snippets, but the 20% of errors were subtle and time consuming to debug. I canceled it.

These days I will occasionally use ChatGpt to ask a coding question (alongside Stack), but automatic AI autocomplete just gets in the way for me. I turn off all autocomplete, generally. The time it saves when it's right is overshadowed by the time it takes to manually fix its errors, especially when it takes me out of the flow.

I don't doubt that it can write higher quality code than I can when properly prompted, but doing so in autocomplete and with a high error rate was more disruptive to this human than helpful. YMMV.

Re:Ask HN: Is anyone using GitHub Copilot in production? by ativzzz on Wednesday December 13, 2023 @03:39PM (#38633825)
I just use it as an autocomplete. I can usually guess when it will save me keystrokes (when I am doing something repetitive) and will look out for it, otherwise usually I ignore what it gives me, but sometimes it surprises me and saves me more than a few keystrokes.

My company pays for it, I don't think I'd pay for it personally since I use chatGPT when I need more advanced help and copilot is just autocomplete.

I think it's only given me full functions a handful of times (and they're usually quite wrong), most of the time it's just a method name or a super short (1-2 line) code snippet

Re:Ask HN: Is anyone using GitHub Copilot in production? by yogini on Thursday December 14, 2023 @01:16AM (#38638386)
I am using it for the Nextjs application.

Mostly using it as an autocomplete but it is quite good for writing repetitive code and logic. Also the new slash commands are pretty useful.

Re:Ask HN: Is anyone using GitHub Copilot in production? by giaour on Thursday December 14, 2023 @01:47PM (#38645362)
I don't use it on my own system, but I will sometimes pair with coworkers who use it. From what I have seen, CoPilot will suggest code that is either subtly wrong or completely broken alongside some really helpful comments. (There must be some selection bias here, since I wouldn't get called in to pair for situations where CoPilot's suggestion was sufficient.)