News for hackers. Stuff that matters.

sha1-1b141e

OOC, how much of the complexity for implementing this was getting the data out of the formats, and how much was implementing the diff once you had the data?
Re:Ask HN: Would you use a “git for data”? on Wednesday April 20, 2016 @06:00PM (#11538073)
Yeah, except that this is not really built into Git. You can't get detailed differences or merge differences in these large files. They are basically opaque blobs as far as Git is concerned.
Re:Ask HN: Would you use a “git for data”? on Wednesday April 20, 2016 @05:53PM (#11538031)
Any kind. JSON or XML could be input. Or things like SQL or protobufs.

Git itself doesn't work well for large-scale data (https://help.github.com/articles/what-is-my-disk-quota/). I'm thinking terabyte or petabyte datasets.

Ask HN: Would you use a “git for data”?

Dear HN:Let's say there was a thing that gave you the full git workflow (branch, sync, push, pull, merge, revert, etc) efficiently for large-scale structured data.Would such a thing be valuable? Would you use it? Would you pay for it?Asking for a friend.

( Read More... | 10 comments | 14 points | on HN )