News for hackers. Stuff that matters.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by LoganDark on Thursday June 08, 2023 @01:02PM (#36245127)
ChatGPT's code generation seems most useful for boilerplate code. I've seen it used to great effect for scaffolding projects that use stable and established frameworks. It'll easily handle generating as much stupid fluff as needed for you to start from—but it will barely get started on your domain-specific use cases, and won't be able to implement anything novel, as you said.

We still don't seem to have reached the point where it's "intelligent" enough to generate new information. Only repeat new permutations of existing information. Obviously, this is currently a fundamental property of LLMs (as someone who's implemented one), since they are trained to learn and repeat existing data (hell, even the model I've been playing with lately is benchmarked solely on "perplexity", how well it can repeat its training data).

Re:Weird GPT-4 behavior for the specific string “ davidjl” by chasd00 on Thursday June 08, 2023 @02:09PM (#36246153)
> ChatGPT's code generation seems most useful for boilerplate code

that makes sense, it's going to be best at the kind of code you find out there on blogs and other sources. Boilerplate or code to demonstrate a specific concept or answer a question.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by LoganDark on Thursday June 08, 2023 @06:18PM (#36250005)
ChatGPT is going to be the best at replicating its training data, because the floor is made out of floor.