News for hackers. Stuff that matters.
Re:OpenAI safety leader quits, warning AI company's culture ... by Retric on Saturday October 03, 2026 @09:58PM (#49949856)
Self improving AI runs into the same issue as prefect comprehension, you can’t get arbitrarily better at everything.

The idea AI can get better at everything at the same time is a holdover from deeply flawed science fiction not some realistic goal.

Re:OpenAI safety leader quits, warning AI company's culture ... by Lerc on Saturday October 03, 2026 @10:32PM (#49950039)
This can be generalised to the curve plotting of the singularity itself.

If the time between advances is a + b and a is the proportion of the period that can be improved by advances then you won't reduce to a gap of nothing between advances, you reduce to a gap of b.

Assume the invention of the plow and the invention of the sword is 500,100 units and a was the 500,000, you wouldn't even know the 100 as in there. Maybe we're at a=2000 now and b is still siting at 100.

Assuming we'll reach infinity because we're dividing by the only variable we see and it is decreasing in size seems nuts if the reason we might not see other variables is because of the size of the variable we can see.

Re:OpenAI safety leader quits, warning AI company's culture ... by afthonos on Saturday October 03, 2026 @10:28PM (#49950025)
Even if you’re right, that doesn’t mean AI can’t get better than humans at everything.
Re:OpenAI safety leader quits, warning AI company's culture ... by treis on Sunday October 04, 2026 @09:19AM (#49953698)
LLMs have consistently and dramatically gotten better at everything over the last 5 years.
Re:OpenAI safety leader quits, warning AI company's culture ... by Retric on Sunday October 04, 2026 @11:38AM (#49954834)
Not at constant processing power, memory, training, etc.

But that’s beside the point, being arbitrarily bad at everything isn’t a problem.

Re:OpenAI safety leader quits, warning AI company's culture ... by treis on Sunday October 04, 2026 @05:11PM (#49957919)
Yes at constant resources they are significantly better.

Diminishing returns aren't necessarily a problem if the rate of increase in resources is faster. In other words, if Gen 2 takes twice the resources but Gen 1 figured out a way to triple compute efficiency then there is no ceiling.

Re:OpenAI safety leader quits, warning AI company's culture ... by Retric on Sunday October 04, 2026 @10:24PM (#49960036)
> Yes at constant resources they are significantly better.

There has been some fundamental advancements in LLM training and efficiency. But good luck actually finding non toy models of exactly the same size, hardware, and training one from now and other from 2001 where the newer model is dramatically better at literally everything.

Most of the real world advances are from throwing ever more resources at the problem.

> Gen 2 takes

Diminishing returns are not a question of a single generation. Gen 2, 3, 4, 5… would also need to have the same 3x return on 2x resources or you don’t have an exponential curve.

Re:OpenAI safety leader quits, warning AI company's culture ... by suddenlybananas on Sunday October 04, 2026 @11:05AM (#49954521)
Yeah and a five-year old gets bigger every year so they'll surely grow up to be 100m tall.