Re:Shrink Go binaries 7x with this one weird trick
by dietrichepp on Monday April 18, 2016 @02:13AM
(#11517989)
I do something similar. I have a database of all my files on S3 and their SHA-256 hashes. This not only means that I can skip uploading files which haven't changed, but I can do S3->S3 copies for files which are the same. But it's still too often that I have 10s or 100s of MB of data to upload. At 1 Mbit/s, it takes a half hour for every 100 MB!
Re:Shrink Go binaries 7x with this one weird trick
by michaelcampbell on Monday April 18, 2016 @09:06AM
(#11519557)
Indeed, sometimes it just sucks and you have to bite the bullet.
This gives me the ability to `rsync` them up rather than copy, using its ability to only transfer the pieces of the files that have changed.
We have a ~20MB .war file that I have done this with over airport wifi, and it ended up only transfer a few 10's of KB (maybe 100) between compiles.