S3 isn't getting cheaper

Re:S3 isn't getting cheaper by gsanderson on Thursday July 28, 2022 @04:02PM (#32269432)

The margin on bandwidth is enormous. I think Cloudflare did some research into it a while back. But there are rivals providing cheaper S3-compatible storage at scale. Cloudflare's R2 ($15/TB, and no fees for egress). Oracle Cloud Storage ($25/TB, and first 10TB of egress is free). There's Wasabi ($5.99/TB, and no fees for egress or API requests). To name but three. Of course each of those have drawbacks e.g Wasabi is intended for long-term storage, R2 is still in beta etc. But there are options for new data.

[ Parent | on HN ]

Re:S3 isn't getting cheaper by jrochkind1 on Thursday July 28, 2022 @06:28PM (#32270818)

I didn't realize Cloudflare R2 was available yet. Took a look based on your mention... "currently in beta". But you can still just sign up and use it already?

Anyone here done that and want to report back?

Ah, I found this posted by it's author elsewhere in these threads:

https://www.vantage.sh/blog/cloudflare-r2-aws-s3-comparison

Very useful. Wait.... "no public access" AND "no pre-signed URLs"? Am I misunderstanding what that means? That would seem to make this not use cases of serving files to end-users? or what am I missing?

[ Parent | on HN ]

Re:S3 isn't getting cheaper by chc on Thursday July 28, 2022 @07:08PM (#32271137)

I haven't used it, but my understanding from reading about it is that the intended use-case is to create a Worker (roughly equivalent to an AWS Lambda) that mediates access to the bucket. So you could have the worker provide public access, or have the worker do some kind of authentication — you just have to roll that part yourself.

[ Parent | on HN ]

Re:S3 isn't getting cheaper by camhart on Thursday July 28, 2022 @07:48PM (#32271455)

They plan on adding features so you don't need to use workers.

See the last section of this article: https://blog.cloudflare.com/r2-open-beta/

[ Parent | on HN ]

Re:S3 isn't getting cheaper by jrochkind1 on Thursday July 28, 2022 @08:05PM (#32271571)

Thanks!

Also interesting to see that a future goal is: "Integration with Cloudflare’s cache, to scale read requests and provide global distribution of data."

I had wrongly assumed that would be the whole point of R2, that it would do that out the gate!

[ Parent | on HN ]

Re:S3 isn't getting cheaper by gsanderson on Thursday July 28, 2022 @07:48PM (#32271454)

I haven't used it either but it certainly sounds like it's open to anyone to use. As @chc mentions, it reads like you use a Worker to control access. So you can make your files public by simply not requiring any authentication. I've just been scrolling through their getting started guide. It looks promising: https://developers.cloudflare.com/r2/get-started

[ Parent | on HN ]

Re:S3 isn't getting cheaper by vlovich123 on Thursday July 28, 2022 @10:54PM (#32272659)

We do have presigned URLs actually. Public buckets coming soon

[ Parent | on HN ]

Re:S3 isn't getting cheaper by jrochkind1 on Friday July 29, 2022 @10:10AM (#32277140)

Thanks! That may meet all my requirements...

Although one of my use cases is video files (fairly small non-profit usage), which I have understood are not allowed by CloudFlare CDN terms of service (at least at non-"enterprise" tiers?)... it's been confusing to me understanding if I could, for example, serve video files from Backblaze via CloudFlare CDN and Bandwidth Alliance; or with R2, if there's a way to serve video files from R2 to the public that is allowed by tos.

[ Parent | on HN ]

Re:S3 isn't getting cheaper by vlovich123 on Sunday July 31, 2022 @02:32PM (#32297583)

Yes you can serve whatever you want from R2 directly. From [1]:

> The Cloudflare Developer Platform consists of the following Services: (i) Cloudflare Workers, a Service that permits developers to deploy and run encapsulated versions of their proprietary software source code (each a “Workers Script”) on Cloudflare’s edge servers; (ii) Cloudflare Pages, a JAMstack platform for frontend developers to collaborate and deploy websites; and (iii) Workers KV, Durable Objects, and R2, storage offerings used to serve HTML and non-HTML content.

Now it’s important to note that the Cache product does not fall into these supplemental terms (even if you use the Workers API to access it). So if you are Caching the video files you’d potentially run into problems (but that would also be true of serving video content from Blackblaze that you were caching).

[1] https://www.cloudflare.com/supplemental-terms/#cloudflare-de...

[ Parent | on HN ]

Re:S3 isn't getting cheaper by jrochkind1 on Monday August 01, 2022 @10:08AM (#32306146)

Thanks this is helpful.

Delivering video files without caching them is probably a mistake, of course!

[ Parent | on HN ]

Re:S3 isn't getting cheaper by i5heu on Friday July 29, 2022 @06:15AM (#32275141)

Sadly this dose not speak about data-integrity via eg. CRC.

Also I don't like it 1mm that I cants see how often and where my data is replicated

[ Parent | on HN ]

Re:S3 isn't getting cheaper by vlovich123 on Friday July 29, 2022 @09:19AM (#32276466)

Overlooked this question:

> But you can still just sign up and use it already

Yes. You can just enter a credit card & start using it.

[ Parent | on HN ]

Re:S3 isn't getting cheaper by ReactiveJelly on Thursday July 28, 2022 @06:10PM (#32270675)

> I think Cloudflare did some research into it a while back

I remember! They called it the Bandwidth Alliance https://www.cloudflare.com/bandwidth-alliance/

[ Parent | on HN ]

Re:S3 isn't getting cheaper by gsanderson on Thursday July 28, 2022 @07:35PM (#32271364)

Yes! That was it. There was a blog post too with the estimated markup: https://blog.cloudflare.com/aws-egregious-egress/

[ Parent | on HN ]

Re:S3 isn't getting cheaper by gerwim on Friday July 29, 2022 @03:19AM (#32274005)

Wasabi's egress is not fully free as you make it sound. Their egress works like this: if you store 1 TB of data, you have 1 TB of free egress, as seen in their FAQ [0]. This means it's unfit for certain cases and another competitor could be a better option.

[0]: https://wasabi.com/paygo-pricing-faq/

[ Parent | on HN ]

Re:S3 isn't getting cheaper by gsanderson on Friday July 29, 2022 @12:51PM (#32279248)

You are correct, that would be another example of one of _its_ drawbacks. They certainly promote "No Fees for Egress" and "No egress charges" (home page). But yes, whether that actually is the case depends on your usage.

[ Parent | on HN ]

Re:S3 isn't getting cheaper by i5heu on Friday July 29, 2022 @06:07AM (#32275074)

> and no fees for egress

This is somewhat wrong. You have to serve R2 Objects via a Worker which will cost you something per hit.

So you have a kind of egress fee.

[ Parent | on HN ]

Re:S3 isn't getting cheaper by gsanderson on Friday July 29, 2022 @01:00PM (#32279336)

True, it should be no fee for egress _bandwidth_. But yes, some form of egress fee (because of the fetch/get operation).

[ Parent | on HN ]