News for hackers. Stuff that matters.

A comment on The Price of Intelligence Is Falling Rapidly. Parent comment

Re:The Price of Intelligence Is Falling Rapidly by BenzeneDream on Wednesday September 23, 2026 @10:00AM (#49816319)
Why would it freeze if they can create more training material. Its already been shown synthetic training data is just as good if not better.
[ Parent | on HN ]
Re:The Price of Intelligence Is Falling Rapidly by timcobb on Wednesday September 23, 2026 @10:10AM (#49816465)
> Its already been shown synthetic training data is just as good if not better.

Source, please! I'm a machine learning layperson but how can this not be overfitting?

[ Parent | on HN ]
Re:The Price of Intelligence Is Falling Rapidly by azakai on Wednesday September 23, 2026 @10:12AM (#49816504)
For example, an LLM can prove a new theorem in math, verify it in Lean (so it is definitely true), and then prove more things based on that.

AI-generated data might not always be that useful, but at least in this case it obviously is.

[ Parent | on HN ]
Re:The Price of Intelligence Is Falling Rapidly by esseph on Wednesday September 23, 2026 @10:32AM (#49816798)
https://arxiv.org/html/2609.26457v1

> AIDE demonstrates that recursive self-improvement at the harness layer can produce transferable gains in an AI research agent’s research efficiency. During the recursive self-improvement run, the loop accepted seven rewrites, each under a fixed evaluation budget (section 3.2). Under this fixed evaluation budget, gains in optimization capability on AI R&D tasks translate to gains in research efficiency."

https://arxiv.org/abs/2609.11873

> The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement

[ Parent | on HN ]