Re:Improving large monorepo performance on GitHub
by skj on Tuesday March 16, 2021 @08:51PM
(#26485223)
Sounds like something to store in not-git.
Re:Improving large monorepo performance on GitHub
by mayank on Tuesday March 16, 2021 @09:29PM
(#26485460)
Git has large file storage now: https://git-lfs.github.com/
Re:Improving large monorepo performance on GitHub
by remram on Tuesday March 16, 2021 @10:25PM
(#26485788)
That is not-git, storing files this way will not increase your repo size. Same with git-annex, same with commiting .txt files with a URL to a file on S3.
Re:Improving large monorepo performance on GitHub
by amelius on Wednesday March 17, 2021 @05:51AM
(#26488765)
I'm using git-shell to serve my repo. Can those extensions run over git-shell? Or do I need to set up a new server?
Re:Improving large monorepo performance on GitHub
by remram on Wednesday March 17, 2021 @01:07PM
(#26493994)
They are separate. git-lfs needs a separate server, that will communicate with the Git client over HTTP (not SSH), and git-annex can use a variety of different backends for storing the data (which doesn't need to be related to the Git repository) such as S3, FTP, webdav, Google Drive, ... and even git-lfs.
GitLab and Gitea come with a git-lfs server, but I don't know if there is any standalone server that you could use with git-shell.
Re:Improving large monorepo performance on GitHub
by amelius on Wednesday March 17, 2021 @01:34PM
(#26494389)
Ok, thanks. This is why I hope large file support will be integrated in Git.
It's just too much of a hassle to figure out the security implications of yet another server, and administrating it, setting up the connection between Git and the plugin, etc.
Just wait until you have to store deep learning training data.