News for hackers. Stuff that matters.

A comment on Tracking SQLite Database Changes in Git. Parent comment

Re:Tracking SQLite Database Changes in Git by skadamat on Thursday November 02, 2023 @08:06AM (#38112345)
Out of the box no, but you can solve the scaling git problem by improving the deduplication: https://xethub.com/assets/docs/faq/how-xet-deduplication-wor...

We're focused on this problem at XetHub.

- Llama2 git repo with ~600 GB of model files: https://xethub.com/XetHub/Llama2

- RedPajama git repo with 3.4 terabytes of data: https://xethub.com/XetHub/RedPajama-Data-1T

[ Parent | on HN ]

There are no comments on this comment yet.