News for hackers. Stuff that matters.
Re:Show HN: Quilt – manage data like code by IanCal on Saturday July 15, 2017 @03:11AM (#14775434)
I don't think you have had to break files up yourself for a long time on S3. You can treat files up to 5TB as a single object. I think you have to do a multipart upload but that's probably not a bad idea anyway.
Re:Show HN: Quilt – manage data like code by rspeer on Monday July 17, 2017 @12:33AM (#14785679)
Ah, right. I'm remembering from when I was trying to use git-annex to version the data, which was a problem for multiple reasons, including that their S3 driver didn't use multipart uploads.