News for hackers. Stuff that matters.
Re:Scaling Git at OpenAI by usrme on Tuesday November 03, 2026 @12:36AM (#50348485)
By my count, this OpenAI post is the fifth major article on the topic of scaling, with the previous four being:

- Cursor: https://cursor.com/blog/git-at-any-scale

- GitHub: https://github.blog/engineering/architecture-optimization/bu...

- Anthropic: https://www.anthropic.com/research/redesigning-source-contro...

- GitHub: https://github.blog/engineering/architecture-optimization/th...

Maybe also tangentially East River Source Control's too: https://ersc.io/blog/what-comes-after-git.

I'm wondering how much cross-pollination of ideas and subsequent implementation details there are between people working at these companies. It does seem like all of this could potentially converge.

Re:Scaling Git at OpenAI by stingraycharles on Tuesday November 03, 2026 @01:07AM (#50348628)
Aren’t the concepts mostly already in place for a decade or two at Meta and Google?

Which would support your argument, but I don’t think this is particularly new.

Re:Scaling Git at OpenAI by KolmogorovComp on Tuesday November 03, 2026 @04:36AM (#50349881)
At least for Anthropic, their article states they've vastly overgrown Meta's and Google's pace.

I think their article reads a bit differently, they haven't optimised git, they've ditched it in favour of a new CVS.

Re:Scaling Git at OpenAI by startracker on Tuesday November 03, 2026 @04:45AM (#50349950)
> CVS

Do you mean VCS?

Re:Scaling Git at OpenAI by smstl on Tuesday November 03, 2026 @04:55AM (#50350019)
freudian cve
Re:Scaling Git at OpenAI by objclxt on Tuesday November 03, 2026 @05:13AM (#50350107)
> At least for Anthropic, their article states they've vastly overgrown Meta's and Google's pace.

I don't think so, their article says they were seeing 30,000 commits a day in September, when I was at Meta six years ago they were easily doing that.

Re:Scaling Git at OpenAI by tedk-42 on Tuesday November 03, 2026 @06:18AM (#50350581)
Size of the commit matters just as much as the total number so there's a missing half not being presented.
Re:Scaling Git at OpenAI by anthonyskipper on Tuesday November 03, 2026 @07:24AM (#50351152)
I would disagree. The size doesn't matter that much. The main metric is just number of commits, because that is what drives the flow. Not saying size doesn't have an effect, just saying number of commits is the primary signal.
Re:Scaling Git at OpenAI by juliusdavies on Tuesday November 03, 2026 @10:04AM (#50352911)
Average number of files changed per commit is going to have a huge impact on performance since that’s a huge part of what the “git push” handshake is trying to figure out regarding what to upload.
Re:Scaling Git at OpenAI by rfgplk on Tuesday November 03, 2026 @04:58AM (#50350033)
Not even close. The rate of code development nowadays far exceeds what Meta _and_ Google combined could output during the early-to-mid 2010s. I wouldn't be surprised if OpenAI is committing over a billion loc a day.
Re:Scaling Git at OpenAI by zeroq on Tuesday November 03, 2026 @01:31AM (#50348763)
Don't forget that Claude just got 3x faster by... using gzip!
Re:Scaling Git at OpenAI by reacharavindh on Tuesday November 03, 2026 @02:44AM (#50349207)
What is this story? Do you have any references on what happened? What did Claude code start to use gzip for?
Re:Scaling Git at OpenAI by solyin on Tuesday November 03, 2026 @02:54AM (#50349262)
https://x.com/claudedevs/status/2111209208012210409

Supposedly they started gzipping the conversations.

Re:Scaling Git at OpenAI by stingraycharles on Tuesday November 03, 2026 @03:20AM (#50349427)
I'm amazed that they're not ashamed that they weren't compressing their requests all this time.
Re:Scaling Git at OpenAI by charamis on Tuesday November 03, 2026 @04:28AM (#50349835)
Their Claude models had not suggested that, so far
Re:Scaling Git at OpenAI by fingerlocks on Tuesday November 03, 2026 @05:01AM (#50350052)
[delayed]
Re:Scaling Git at OpenAI by stingraycharles on Tuesday November 03, 2026 @05:24AM (#50350179)
I can only assume the whole announcement is about enabling http compression.
Re:Scaling Git at OpenAI by koolba on Tuesday November 03, 2026 @06:47AM (#50350802)
At least they weren’t using brotli.
Re:Scaling Git at OpenAI by ethanj8011 on Tuesday November 03, 2026 @08:44AM (#50351894)
Wait till they find out about zstd...
Re:Scaling Git at OpenAI by gritzko on Tuesday November 03, 2026 @01:32AM (#50348767)
I remember sharing packlog ideas on the Git Discord. God knows whom I cross-pollinated then.

I think Git is becoming a protocol and that is good. Let a thousand flowers bloom. On the other hand, would any of the parties mentioned share their code with anyone? If so, would anyone be ever interested in using it?

Re:Scaling Git at OpenAI by gritzko on Tuesday November 03, 2026 @02:09AM (#50348993)
The blog post paints a vivid picture of a slop volcano. We speak of code its authors never read, never share, and never accept patches. So the entire point of git is moot.

On the other hand, some lower-level tools have to be simple, reliable and efficient. Here, sharing is critical. Even the authors of the post shared some incremental improvements to git. Here, the slop-cannon-scalability story is moot.

I think git is becoming a protocol. One product can no longer cover these cases.

Re:Scaling Git at OpenAI by fullstackwife on Tuesday November 03, 2026 @02:29AM (#50349109)
What got us here won't get us there perhaps? Can you tell why open source started to exist in first place? Wasn't that a way to crowdsource manual labour, and this reason is not valid anymore, as cost of this spiecif labour is near zero?
Re:Scaling Git at OpenAI by conartist6 on Tuesday November 03, 2026 @03:25AM (#50349469)
What if I told you that I could add ten million pages to the US tax code right now at zero cost. Would you be excited?
Re:Scaling Git at OpenAI by matwood on Tuesday November 03, 2026 @04:33AM (#50349863)
Depends on the problem those million pages solved. If it meant the government sent me a prepopulated tax form that I could just sign if I agreed with the numbers and be done - yes, I would be extremely excited.
Re:Scaling Git at OpenAI by tempfile on Tuesday November 03, 2026 @05:15AM (#50350112)
... and if you don't agree with the numbers?
Re:Scaling Git at OpenAI by matwood on Tuesday November 03, 2026 @06:05AM (#50350463)
Then you can do the whole file process. For most people the government gets all the data. The filing process is purposely keeping tax companies in business today.

The point of my response is that the analogy was broken without saying what adding those pages could provide.

Re:Scaling Git at OpenAI by tempfile on Tuesday November 03, 2026 @07:14AM (#50351041)
Right, but now there are a million extra pages in the filing process. Many more companies would be kept in business to deal with the extra garbage!

The analogy isn't broken. Your objection didn't really make sense, because adding pages to the tax code makes the tax code strictly more complicated. Your response just ignored the case where that complexity actually matters.

Re:Scaling Git at OpenAI by fullstackwife on Tuesday November 03, 2026 @05:12AM (#50350097)
Tax law is a 100% human slop
Re:Scaling Git at OpenAI by singularity2001 on Tuesday November 03, 2026 @02:36AM (#50349152)

  "the entire point of git is moot"
agents benefit from the same abstractions as humans do and they also benefit from a version system where the history can be tracked back where merch conflicts become obvious and so on
Re:Scaling Git at OpenAI by 5petabytesofwha on Tuesday November 03, 2026 @02:47AM (#50349230)
I... Unfortunately agree.

I am watching OpenAI's output, and while a lot of it is absurdly impressive, I can not even begin to imagine what kind of activity of theirs justifies a through-output of 5 petabytes of -GIT COMMITS-. That's not their data sets, that's not their models, that's not their math library. That's their code.

They're rengineering Git for scale, but like, why is there a demand for scale at all? If i saw an employee flipping the same number on an excel file over and over, I'd fire them, and yet they're perfectly happy running agents that do that and setting up meetings and writing blogposts about how much they improved their spreadsheet number randomization factory.

Re:Scaling Git at OpenAI by bluerooibos on Tuesday November 03, 2026 @02:41AM (#50349180)
> fifth major article

Seventh, at least, all the major code forges are on it: https://about.gitlab.com/blog/scaling-git-for-the-agentic-so...

Entire also seems focused on this: https://entire.com/news/entire-launches-distributed-git-netw...

Re:Scaling Git at OpenAI by amelius on Tuesday November 03, 2026 @03:47AM (#50349586)
Ideas are getting cheaper with the day, so convergence is less likely every day too.
Re:Scaling Git at OpenAI by tempfile on Tuesday November 03, 2026 @05:12AM (#50350099)
Cheaper and worse!