Re:How we built a new, fast file transfer protocol
by mcharawi on Saturday March 26, 2022 @12:48PM
(#30813373)
Hey HN! I'm Mahamad, co-founder of Tachyon Transfer, where we're building faster file transfer tools for developers. We've spent the last year building an ultra-fast FTP replacement, and we thought we'd show you guys what our technical process was like. Let me know if you have any questions!
[ Parent
| on HN ]
Re:How we built a new, fast file transfer protocol
by KennyBlanken on Saturday March 26, 2022 @03:43PM
(#30814735)
Please show performance tests versus hpn-ssh, GridFTP (aka, the defacto tool of the particle physics and genetics research communities) and simpler systems like wget2's multi-threaded mode.
Re:How we built a new, fast file transfer protocol
by eps on Saturday March 26, 2022 @06:09PM
(#30815814)
Would also be nice to compare against different standard TCP congestion avoidance algs, of which there's plenty.
It is, after all, a very well researched area.
Re:How we built a new, fast file transfer protocol
by Bancakes on Saturday March 26, 2022 @01:38PM
(#30813717)
Can I tunnel this over SSH and use it the same way as faster drop-in replacement for SFTP? (Why not?)
Re:How we built a new, fast file transfer protocol
by mcharawi on Saturday March 26, 2022 @02:05PM
(#30813929)
Standard SSH uses TCP over port 22 by default, so it wouldn't be possible without modifying SSH to use a different protocol. That being said, however, our protocol uses TLS over UDP via the OpenSSL libraries so it is secure by default. We also offer a BSD-style socket interface that you can use if you want a drop in replacement for TCP sockets. Shoot me a note at mahamad _at_ trytachyon _dot_ com if you want to chat!
Re:How we built a new, fast file transfer protocol
by klabb3 on Saturday March 26, 2022 @07:08PM
(#30816170)
What's the difference between "TLS over UDP" and Quic? Did you compare your solution to some Quic implementation?
Also, how was CPU usage? In my experience UDP-based stream protocols do signifanctly worse (I assume due to user-space scheduling and unoptimized hot paths). This may be particularly relevant for laptops and mobile.
Re:How we built a new, fast file transfer protocol
by unmole on Saturday March 26, 2022 @08:41PM
(#30816665)
> What's the difference between "TLS over UDP" and Quic?
QUIC is much much more than TLS over UDP.
Re:How we built a new, fast file transfer protocol
by hansel_der on Sunday March 27, 2022 @10:58AM
(#30820708)
how much?
Re:How we built a new, fast file transfer protocol
by unmole on Sunday March 27, 2022 @11:32AM
(#30821016)
Ha! Around 4 RFCs and 20 Internet Drafts more: https://datatracker.ietf.org/wg/quic/documents/
Re:How we built a new, fast file transfer protocol
by tener on Saturday March 26, 2022 @02:07PM
(#30813948)
Can you share some actual performance numbers across whatever are the key metrics that you observe?
Re:How we built a new, fast file transfer protocol
by rsync on Saturday March 26, 2022 @02:03PM
(#30813910)
Is this software that one licenses and uses on any arbitrary network or do you run a network of some kind that users pay to access?
Or both ?
I think this is a software package but the tl;dr doesn’t make that clear to me…