GPT-4 increased BCG consultants’ performance by over 40%

Re:GPT-4 increased BCG consultants’ performance by over 40% by matheusmoreira on Saturday September 30, 2023 @01:06PM (#37717429)

I've been using it for code review. I just paste some of my code in and ask the AI to critique it, suggest ideas and improvements. Makes for a less lonely coding experience. Wish I could point it to my git repositories and have it review the entire projects.

I've had mixed experiences with getting it to generate new code. It produced good node.js command line application code. It didn't do so well at writing a program that creates 16 bit PCM audio file. I asked it to explain the WAV file format and things like lengths of structures got so confusing I had to research the stuff to figure out the truth.

[ Parent | on HN ]

Re:GPT-4 increased BCG consultants’ performance by over 40% by airstrike on Saturday September 30, 2023 @02:15PM (#37718194)

This mirrors my experience. Very helpful writing node.js application code, but struggles to walk through simple operations in assembly. My hunch is that the tokenization process really hurts keeping the 1s and 0s straight.

It's been hit or miss with rust. It's super helpful in decrypting compilation errors, decent with "core rust" and less helpful with 3rd party libraries like the cursive TUI crate

Which comes as no surprise, really, as there's certainly less training data on the cursive crate than, say, expressjs

Also FWIW I have actually pointed it at entire git repos with the WebPilot plugin within ChatGPT and it could explain what the repo did, but getting it to actually incorporate the source files as it wrote new code didn't work quite so well (I pointed it to https://github.com/kean/Get and it would frequently fall back to writing native Swift code for HTTP requests instead of using the library)

[ Parent | on HN ]