News for hackers. Stuff that matters.
Re:Oxen.ai: Very Fast Unstructured Data Version Control by remram on Monday February 20, 2023 @11:24PM (#34876572)
LFS is slow (copies files during checkout, downloads/uploads files independently), inefficient (no de-duplication or delta encoding, contrary to base Git), error-prone (needs manual setup, and rewriting history if anyone gets it wrong), and otherwise not well integrated (it relies on smudge filter and other hooks, so some Git commands are aware of it and others not. You will often see the `version ... oid ...` content of the actual blob rather than the large file).
Re:Oxen.ai: Very Fast Unstructured Data Version Control by unshavedyak on Tuesday February 21, 2023 @09:38AM (#34881672)
> and otherwise not well integrated (it relies on smudge filter and other hooks, so some Git commands are aware of it and others not. You will often see the `version ... oid ...` content of the actual blob rather than the large file).

Curious, do you know the solutions here? I've looked into integrating Git LFS-like things into Git and it felt like Git doesn't give you many tools. Smudging, as hacky as it is, feels one of a very small pool of options you have. I want to say Git Annex does something slightly different.

Regardless Smudging felt fine due to how difficult Git made it. Are there better ways in your mind?

Re:Oxen.ai: Very Fast Unstructured Data Version Control by remram on Tuesday February 21, 2023 @10:37AM (#34882289)
I don't think you can do better if you don't want to change Git, no.
Re:Oxen.ai: Very Fast Unstructured Data Version Control by unshavedyak on Tuesday February 21, 2023 @10:43AM (#34882370)
Seems like an odd critique of LFS then, no? Your other points are super valid, i've wanted to replace LFS with my own impl for the same reasons _(also it was originally designed for HTTP servers, ugh)_. However the integration is roughly as good as it can be, no? Or rather, Oxen would suffer the same limitations no?
Re:Oxen.ai: Very Fast Unstructured Data Version Control by remram on Tuesday February 21, 2023 @10:28PM (#34891257)
I'm not trying to target this critique at LFS specifically and absolve Git. It might be that LFS is a bad product because of Git's limited extension points, it remains a bad product.