Re:Show HN: Exatorrent – Self-hostable Torrent client writte...
by mishafb on Wednesday August 25, 2021 @12:27PM
(#28303627)
Isn't most of the bandwidth spent on packages? Even immediately after the initial install you probably have gigabytes of updates + new packages.
[ Parent
| on HN ]
Re:Show HN: Exatorrent – Self-hostable Torrent client writte...
by systemvoltage on Wednesday August 25, 2021 @12:41PM
(#28303766)
I often wonder - who pays for pip packages that millions of server apps and CI/CD pipelines pull? There is some caching but still it’s gotta be enormous.
Re:Show HN: Exatorrent – Self-hostable Torrent client writte...
by dwrodri on Wednesday August 25, 2021 @01:55PM
(#28304650)
The official PyPI packkages are hosted on Fastly. I believe they donate the infrastructure costs through the Python Software Foundation, as the bandwidth is over 300TB a day, and would cost about 1.8 million dollars a month.
Source: https://dustingram.com/articles/2021/04/14/powering-the-pyth...
Re:Show HN: Exatorrent – Self-hostable Torrent client writte...
by minusf on Wednesday August 25, 2021 @06:09PM
(#28307767)
interesting article. where is the 300 TB number coming from?
> The “maximum” here is per-day, so this means that at the peak (which was the day I made these graphs) PyPI served nearly 900 terabytes over more than 2 billion requests per day.
Re:Show HN: Exatorrent – Self-hostable Torrent client writte...
by dwrodri on Wednesday August 25, 2021 @06:27PM
(#28307953)
This tweet from Dustin Ingram: https://twitter.com/di_codes/status/1235707819955032069
I think this number is dated but its what I stumbled across.
Re:Show HN: Exatorrent – Self-hostable Torrent client writte...
by minusf on Wednesday August 25, 2021 @06:34PM
(#28308013)
might be. either way the numbers are impressive although i am afraid this massive bandwidth is necessary because of the docker's and ci/cd's that don't use caches...
Re:Show HN: Exatorrent – Self-hostable Torrent client writte...
by yjftsjthsd-h on Wednesday August 25, 2021 @01:39PM
(#28304421)
Yeah, it still blows my mind that nobody seems to have solved putting packages in torrents.
Re:Show HN: Exatorrent – Self-hostable Torrent client writte...
by rovr138 on Wednesday August 25, 2021 @01:59PM
(#28304717)
Apt-torrent - https://directory.fsf.org/wiki/Apt-torrent
I haven't used this a long time, but it used to be faster than mirrors where I was.