Re:Show HN: Quilt – manage data like code
by IanCal on Saturday July 15, 2017 @03:11AM
(#14775434)
I don't think you have had to break files up yourself for a long time on S3. You can treat files up to 5TB as a single object. I think you have to do a multipart upload but that's probably not a bad idea anyway.
[ Parent
| on HN ]
Ah, right. I'm remembering from when I was trying to use git-annex to version the data, which was a problem for multiple reasons, including that their S3 driver didn't use multipart uploads.