It's actually quite elegant; a control connection over SSH plus a custom UDP protocol (FASP) for data. It does work as advertised and has some nice features that are handy in production, but licensing is very expensive ($20K for point-to-point at 1gb/s).
Can you, or somebody else please name some? It always irks me a little when someone just mentions that "these projects" exist, and then fail to mention any of them.
We offer a custom protocol file transfer as a service (uses UDP instead of TCP), but you can do a home grown solution yourself very easily.
If you have a big file of compressed content (video), do the following. If you have a lot of small files, tar and gzip them, then do the following.
md5 your file
split your file into chunks (eg parts _a - _z, or _aa - _zz)
use ncftp or similar capable of parallel transfers
optimize between 8 and 30 parallel depending on latency to saturate link
concat the file at the other end
check the md5
You can handily saturate a link from EU to Australia or India to US this way.That said, for Aussie customers sending us 1000s of movies, we FedEx or DHL pelican cases full of drives.
The main example I've heard is special effects companies like Weta Digital in New Zealand wanting to deliver video to the US across a 200ms latency link.
There are a few open protocols in various stages of development or you can pay for a product like FileCatalyst http://www.filecatalyst.com/ ( some interesting case studies on their website ).