News for hackers. Stuff that matters.
Re:The 2025 AI Index Report by xboxnolifes on Thursday April 10, 2025 @03:29PM (#43647287)
If this isn't what you meant, then what did you mean? To me, it's exactly how I read what you said.
Re:The 2025 AI Index Report by namaria on Thursday April 10, 2025 @03:54PM (#43647482)
I am sorry but that's nonsense.

I quoted the paper "Evolution through Large Models" written in collaboration between OpenAI and Anthropic researchers

"In other words, the model learns to predict plausible changes to code from examples of changes made to code by human programmers."

https://arxiv.org/pdf/2206.08896

> The idea that models can only write code if they've seen code that does the exact same thing in the past

How do you get "code that does the exact same thing" from "predicting plausible changes?"

Re:The 2025 AI Index Report by simonw on Thursday April 10, 2025 @04:18PM (#43647676)
That paper describes an experimental diff-focused approach from 2022. It's not clear to me how relevant it is to the way models like Claude 3.7 Sonnet (thinking) and o3-mini work today.
Re:The 2025 AI Index Report by namaria on Thursday April 10, 2025 @05:02PM (#43647989)
If do not you think past research by OpenAI and Anthropic on how to use LLMs to generate code is relevant to how Anthropic LLMs generate code 3 years later I really don't think it is possible to have a reasonable conversation about this topic with you.
Re:The 2025 AI Index Report by simonw on Thursday April 10, 2025 @05:34PM (#43648238)
Can we be sure that research became part of their mainline model development process as opposed to being an interesting side-quest?

Are Gemini and DeepSeek and Llama and other strong coding models using the same ideas?

Llama and DeepSeek are at least slightly more open about their training processes so there might be clues in their papers (that's a lot of stuff to crunch through though).