News for hackers. Stuff that matters.
Re:We Put Half a Million Files in One Git Repository, Here’s... by zoomablemind on Thursday June 16, 2022 @01:53AM (#31762826)
> "...we found that .xlf files made up almost 70% of the total number of files. These .xlf files are generated... they are never manually edited by engineers..."

First thought is why not to zip/tar away all of these "convenience" files per generation and add a line into build/install script to unpack them after checkout?

Additionally, add the .xlf into .gitignore to exclude them from untracked.

Noone cares to diff them as long as their contents is consistent with the checkout. Text compresses quite efficiently so this should not introduce any unreasonable build/install delays.

Re:We Put Half a Million Files in One Git Repository, Here’s... by haizzz on Thursday June 16, 2022 @02:37AM (#31763082)
I made another comment as well though tldr is these xlf files are translations tied to texts in code so we can't simply ignore them from the repository. The changes have to be kept so that if we say revert to a certain commit, all the translations match with the texts of headers, buttons, etc...
Re:We Put Half a Million Files in One Git Repository, Here’s... by zoomablemind on Thursday June 16, 2022 @07:47AM (#31764870)
>...The changes have to be kept so that if we say revert to a certain commit, all the translations match with the texts of headers, buttons, etc...

The mentioned .zip file is to be kept in the repo. Instead of a whatever number of individual .xlf files per generation, these would get zipped together (say, 'assets/xlf.zip') before the commit and the resulting .zip added to the commit.

Similarly, when reverting or on a checkout, it's the .zip that gets checked out and then the .xlf files are unpacked.

The packing/unpacking could be done by the same process that handles the .xlf generation (??build).

Also this may be automated by git-hooks, though it's more natural to handle the packing of assets during the build stage.

Re:We Put Half a Million Files in One Git Repository, Here’s... by GeneralMaximus on Thursday June 16, 2022 @04:49AM (#31763802)
Could these translations be moved to another repository? Maybe they could be published as a separate NPM package that devs could install if they needed to look at the translations?
Re:We Put Half a Million Files in One Git Repository, Here’s... by klysm on Thursday June 16, 2022 @07:14AM (#31764677)
Then you get the annoying problem of having to push an update to that repo and wait for the new version before you can merge changes into the new repo which use the new version. It’s tightly coupled, so they should be co-located.
Re:We Put Half a Million Files in One Git Repository, Here’s... by jeffhuys on Thursday June 16, 2022 @11:04AM (#31766889)
The entire workflow could remain the same while tar/zipping goes on in the background...