News for hackers. Stuff that matters.
Re:Ask HN: Transfer Large Amounts of Data by version_five on Tuesday December 06, 2022 @08:10PM (#33889465)
What kind of constraints are you under, or what are you trying to optimize for? In many circumstances that wouldn't be considered a lot of data. Is low bandwidth the issue? If so, physical sharing the hard drive, or even mailing a usb hard drive makes sense. How valuable is the data and how much is your time worth?
Re:Ask HN: Transfer Large Amounts of Data by Alifatisk on Tuesday December 06, 2022 @08:22PM (#33889568)
I don't think none of us are in any constrains, we both have high-speed network (around 300 Mb/s down and 50 Mb/s up).

What I am trying to optimize for is the transfer rate, I would prefer this transfer takes less than a couple of hours.

The data is not that valuable, it would just be nice to have.

Re:Ask HN: Transfer Large Amounts of Data by version_five on Tuesday December 06, 2022 @08:38PM (#33889698)
Just try transfering it with sftp and see what kind of speed you get. Maybe use tar first to make a few big files, which will reduce overhead
Re:Ask HN: Transfer Large Amounts of Data by Alifatisk on Tuesday December 06, 2022 @08:48PM (#33889762)
Interesting, I'll add this to my list.