Re:A Desperate Plea for a Free Software Alternative to Asper...
by ovidiul on Sunday December 29, 2019 @04:03PM
(#21908455)
This looks interesting as well as it's developed at CERN and uses plain tcp protocol https://github.com/fast-data-transfer/fdt
[ Parent
| on HN ]
Re:A Desperate Plea for a Free Software Alternative to Asper...
by YarickR2 on Sunday December 29, 2019 @04:40PM
(#21908703)
Second this. When we needed to deal with somewhat similar issues (quickly transfer multi-gigabyte archives over massively unreliable link) , we ended up with FDT ; it can be easily scripted , and transfers data between two hosts (without using a network of torrent peers) at that hosts' link speed. Used it to transfer builds between US and Russia, and Russia and China .
Re:A Desperate Plea for a Free Software Alternative to Asper...
by branzo on Monday December 30, 2019 @12:02AM
(#21910930)
+1
Used fdt to transfer a 6TB archive out of AWS very smoothly at full speed.
Re:A Desperate Plea for a Free Software Alternative to Asper...
by beojan on Sunday December 29, 2019 @05:09PM
(#21908909)
Or [rucio](https://rucio.cern.ch/).