News for hackers. Stuff that matters.
Re:How we built a new, fast file transfer protocol by mcharawi on Saturday March 26, 2022 @12:48PM (#30813373)
Hey HN! I'm Mahamad, co-founder of Tachyon Transfer, where we're building faster file transfer tools for developers. We've spent the last year building an ultra-fast FTP replacement, and we thought we'd show you guys what our technical process was like. Let me know if you have any questions!
Re:How we built a new, fast file transfer protocol by KennyBlanken on Saturday March 26, 2022 @03:43PM (#30814735)
Please show performance tests versus hpn-ssh, GridFTP (aka, the defacto tool of the particle physics and genetics research communities) and simpler systems like wget2's multi-threaded mode.
Re:How we built a new, fast file transfer protocol by eps on Saturday March 26, 2022 @06:09PM (#30815814)
Would also be nice to compare against different standard TCP congestion avoidance algs, of which there's plenty.

It is, after all, a very well researched area.

Re:How we built a new, fast file transfer protocol by Bancakes on Saturday March 26, 2022 @01:38PM (#30813717)
Can I tunnel this over SSH and use it the same way as faster drop-in replacement for SFTP? (Why not?)
Re:How we built a new, fast file transfer protocol by mcharawi on Saturday March 26, 2022 @02:05PM (#30813929)
Standard SSH uses TCP over port 22 by default, so it wouldn't be possible without modifying SSH to use a different protocol. That being said, however, our protocol uses TLS over UDP via the OpenSSL libraries so it is secure by default. We also offer a BSD-style socket interface that you can use if you want a drop in replacement for TCP sockets. Shoot me a note at mahamad _at_ trytachyon _dot_ com if you want to chat!
Re:How we built a new, fast file transfer protocol by klabb3 on Saturday March 26, 2022 @07:08PM (#30816170)
What's the difference between "TLS over UDP" and Quic? Did you compare your solution to some Quic implementation?

Also, how was CPU usage? In my experience UDP-based stream protocols do signifanctly worse (I assume due to user-space scheduling and unoptimized hot paths). This may be particularly relevant for laptops and mobile.

Re:How we built a new, fast file transfer protocol by unmole on Saturday March 26, 2022 @08:41PM (#30816665)
> What's the difference between "TLS over UDP" and Quic?

QUIC is much much more than TLS over UDP.

Re:How we built a new, fast file transfer protocol by hansel_der on Sunday March 27, 2022 @10:58AM (#30820708)
how much?
Re:How we built a new, fast file transfer protocol by unmole on Sunday March 27, 2022 @11:32AM (#30821016)
Ha! Around 4 RFCs and 20 Internet Drafts more: https://datatracker.ietf.org/wg/quic/documents/
Re:How we built a new, fast file transfer protocol by tener on Saturday March 26, 2022 @02:07PM (#30813948)
Can you share some actual performance numbers across whatever are the key metrics that you observe?
Re:How we built a new, fast file transfer protocol by rsync on Saturday March 26, 2022 @02:03PM (#30813910)
Is this software that one licenses and uses on any arbitrary network or do you run a network of some kind that users pay to access?

Or both ?

I think this is a software package but the tl;dr doesn’t make that clear to me…

Re:How we built a new, fast file transfer protocol by mcharawi on Saturday March 26, 2022 @04:26PM (#30815062)
At the moment we offer both options. We offer our own network with a pricing plan similar to massive.io (though 10c per gb vs 25c) Our licensing is cheaper but requires large volumes.