News for hackers. Stuff that matters.
Re:Apple downloads ~45 TB of models per day from our S3 bucket by toomuchtodo on Monday September 16, 2019 @03:37PM (#20987777)
Backblaze B2 + Cloudflare = free outbound transfer (bandwidth alliance).

Making objects in S3 publicly available and then complaining about their extortionate bandwidth charges is...silly.

Re:Apple downloads ~45 TB of models per day from our S3 bucket by reitzensteinm on Monday September 16, 2019 @05:48PM (#20988907)
If you try to serve a petabyte of binary data a month through Cloudflare, they're going to shut you down.

S3 is very expensive, but averaging 4 gigabits 24x7 is not going to be cheap anywhere.

Re:Apple downloads ~45 TB of models per day from our S3 bucket by parliament32 on Monday September 16, 2019 @06:07PM (#20989036)
>averaging 4 gigabits 24x7 is not going to be cheap anywhere

A normal upstream (if you were in a colo or some sort of DC) will charge you about $0.50 per meg. So, 4gbps would cost you... $200/mo. [1]

I think people don't realize just how much more expensive IaaS providers are. We're literally talking orders of magnitude.

[1] https://blog.telegeography.com/outlook-for-ip-transit-prices...

Re:Apple downloads ~45 TB of models per day from our S3 bucket by reitzensteinm on Monday September 16, 2019 @07:29PM (#20989574)
$2000, it seems like you dropped a zero. And you're presumably going to need some burst capacity, so call it $4k for a 2:1 ratio if you care about not throttling at peak times.

The big cloud providers are very expensive, but you're getting impeccable bandwidth. Low packet loss, burst what you want even in peak times, fast transit worldwide, minimal variability.

What most people actually don't realize is that they're making that tradeoff implicitly. You're not being ripped off if you need all of these things, but if it's overkill you can get much cheaper bandwidth elsewhere.

Re:Apple downloads ~45 TB of models per day from our S3 bucket by joecot on Monday September 16, 2019 @04:43PM (#20988370)
Backblaze B2 + Cloudflare would be a perfect combination for hosting a static site. Unfortunately there's no way to map a Backblaze bucket to a domain, so even if you use cloudflare to point www.mydomain.com to it your files still show up at www.mydomain.com/path/to/bucket.

But it certainly works if you need to CDN a bunch of large files.

Re:Apple downloads ~45 TB of models per day from our S3 bucket by jrullman on Monday September 16, 2019 @04:49PM (#20988455)
You can use Cloudflare Workers to rewrite the path.
Re:Apple downloads ~45 TB of models per day from our S3 bucket by zenexer on Monday September 16, 2019 @07:47PM (#20989683)
Those get fairly expensive if you have a lot of requests.

Page rules are free if you only need a few, though.

Re:Apple downloads ~45 TB of models per day from our S3 bucket by joecot on Tuesday September 17, 2019 @12:04PM (#20996815)
3 pages rules are free. You need at least 2 page rules per website you want to use with Backblaze and Cloudflare, and that's for bare minimum workability.

For a commercial company paying $5-10 a month to save TBs of bandwidth via Backblaze & Cloudflare is a no brainer. It's just unfortunately not very workable for small projects. Github Pages works with Cloudflare for static sites just fine though.

Re:Apple downloads ~45 TB of models per day from our S3 bucket by julien_c on Monday September 16, 2019 @03:45PM (#20987853)
I had intended to look into Cloudflare before but didn't get a chance. Looks like it's a good time now!
Re:Apple downloads ~45 TB of models per day from our S3 bucket by qes on Monday September 16, 2019 @10:07PM (#20990533)
Cloudflare will cut you off and require a paid plan before you get to 1/10th this amount of egress.
Re:Apple downloads ~45 TB of models per day from our S3 bucket by toomuchtodo on Monday September 16, 2019 @10:31PM (#20990675)
Still cheaper than AWS!