News for hackers. Stuff that matters.
Re:The bandwidth of a Boeing 747 and its impact on web browsing by efuquen on Thursday June 21, 2012 @10:21AM (#4142088)
"There are a few open protocols in various stages of development"

Can you, or somebody else please name some? It always irks me a little when someone just mentions that "these projects" exist, and then fail to mention any of them.

Re:The bandwidth of a Boeing 747 and its impact on web browsing by EvanAnderson on Thursday June 21, 2012 @10:58AM (#4142294)
We had a discussion about this over on Server Fault (http://serverfault.com/q/111813/7200) and UFTP (http://www.tcnj.edu/~bush/uftp.html), UDT (http://udt.sourceforge.net/), and Tsunami-UDP (http://tsunami-udp.sourceforge.net/) all came up as viable open source offerings (along with FileCatalyst and Aspera in the commercial space).
Re:The bandwidth of a Boeing 747 and its impact on web browsing by Terretta on Thursday June 21, 2012 @05:21PM (#4144254)
No need to over engineer...

We offer a custom protocol file transfer as a service (uses UDP instead of TCP), but you can do a home grown solution yourself very easily.

If you have a big file of compressed content (video), do the following. If you have a lot of small files, tar and gzip them, then do the following.

    md5 your file
    split your file into chunks (eg parts _a - _z, or _aa - _zz)
    use ncftp or similar capable of parallel transfers
    optimize between 8 and 30 parallel depending on latency to saturate link
    concat the file at the other end
    check the md5
You can handily saturate a link from EU to Australia or India to US this way.

That said, for Aussie customers sending us 1000s of movies, we FedEx or DHL pelican cases full of drives.