Re:The bandwidth of a Boeing 747 and its impact on web browsing
by EvanAnderson on Thursday June 21, 2012 @10:58AM
(#4142294)
We had a discussion about this over on Server Fault (http://serverfault.com/q/111813/7200) and UFTP (http://www.tcnj.edu/~bush/uftp.html), UDT (http://udt.sourceforge.net/), and Tsunami-UDP (http://tsunami-udp.sourceforge.net/) all came up as viable open source offerings (along with FileCatalyst and Aspera in the commercial space).
Re:The bandwidth of a Boeing 747 and its impact on web browsing
by Terretta on Thursday June 21, 2012 @05:21PM
(#4144254)
No need to over engineer...
We offer a custom protocol file transfer as a service (uses UDP instead of TCP), but you can do a home grown solution yourself very easily.
If you have a big file of compressed content (video), do the following. If you have a lot of small files, tar and gzip them, then do the following.
md5 your file
split your file into chunks (eg parts _a - _z, or _aa - _zz)
use ncftp or similar capable of parallel transfers
optimize between 8 and 30 parallel depending on latency to saturate link
concat the file at the other end
check the md5
You can handily saturate a link from EU to Australia or India to US this way.That said, for Aussie customers sending us 1000s of movies, we FedEx or DHL pelican cases full of drives.
Can you, or somebody else please name some? It always irks me a little when someone just mentions that "these projects" exist, and then fail to mention any of them.