This is completely orthogonal to the inference and training stack that the parent comment mentions
If it’s written by AI it’s gonna be the same overcomplicated overfit slop in one way or another. Performance pressure doesn’t fix that.
Re:Scaling Git at OpenAI
by stingraycharles on Monday November 02, 2026 @11:56PM
(#50348257)
Assuming it’s entirely unsupervised, yes, which I can only assume to be the case at these volumes (hence the dogfooding).
I do believe this will force the AI labs to eventually solve the bloat problem with AI, but we’re definitely not there yet.
Re:Scaling Git at OpenAI
by aurareturn on Tuesday November 03, 2026 @12:03AM
(#50348296)
Depends on what the goal is and the skill of the engineer right?
Give a verifiable benchmark for the AI agent to hit such as reduce token processing time by 5% without affecting output.
Different metrics. You measure how many users you have, whether they’re closing the app and etc. when it comes to consumer level apps. ChatGPT/Claude is heavily used, not a problem for an average user, so no need to improve that.
Kernels, performance-required stacks etc. is different, so you optimise them for that.
Re:Scaling Git at OpenAI
by reacharavindh on Tuesday November 03, 2026 @03:34AM
(#50349520)
I think Deepseek did this in the most focussed way.. their own optimization (key value caches, downscaled images for vision support etc) in their inference stack to push the boundaries in favor at a time of hardware scarcity.
It feels like OpenAI and Anthropic have a ton of room to optimizing that regard, but they choose to rather focus on moving the frontier forward than doing things that are already possible in a more efficient way.
I think it’s simply a matter of dogfooding and new feature development, they do have much higher velocity than companies of equivalent size and an unlimited token budget helps as well.