News for hackers. Stuff that matters.
Re:Requests dropped when using Cloudflare’s free tier for a ... by jgrahamc on Monday February 08, 2021 @07:02AM (#26063388)
I am talking internally with the customer support team about what happened to this customer's traffic. It is definitively not the case that doing "four requests per minute" gets you rate limited.
Re:Requests dropped when using Cloudflare’s free tier for a ... by Abishek_Muthian on Monday February 08, 2021 @07:55AM (#26063802)
My application[1] with similar rpm as OP received 503 status last month for about an hour first time in 1.5 years, I assumed it to be an one-off issue at CF end. It happened while I was using it and so I'm now concerned if it's a regular affair for my users, most of whom are not from my geographical location(data-center).

I'm a free plan user because my application is not monetized and obviously would switch to paid plan once it starts generating money. CF free plan has been indispensable for many such free projects.

UptimeRobot(Free) doesn't show anything fishy, except for CF error 521 occasionally. Again UptimeRobot requires paid version to check for HTTP status message, guess I'll have to do it or setup a self hosted(recommendations?) solution to monitor HTTP status of CF Free application.

If CF does perform rate limiting for such low rpm, I would prefer to be intimated as even third rate shared hosting providers do it and I hope CF wouldn't put their reputation on the line for something like this.

[1]https://needgap.com

Re:Requests dropped when using Cloudflare’s free tier for a ... by jgrahamc on Monday February 08, 2021 @10:18AM (#26065632)
Talk to support.
Re:Requests dropped when using Cloudflare’s free tier for a ... by dmortin on Monday February 08, 2021 @07:32AM (#26063617)
Why don't you send an email to the customer if there is an error while serving content by cloudflare? It can be a daily digest of the errors of the day.

If the problem is on cloudflare's side then the cloudflare user doesn't even know about it if it's an intermittent error.

Re:Requests dropped when using Cloudflare’s free tier for a ... by codetrotter on Monday February 08, 2021 @07:13AM (#26063458)
While we are on the subject of rate limiting and such, does Cloudflare allow using its service for serving video files for a media heavy social media app where we store the videos on Backblaze B2?

I’m working on such an app, and am hoping to use Cloudflare + Backblaze B2, because of the bandwidth alliance. https://www.cloudflare.com/en-gb/bandwidth-alliance/

However, the Terms of Service say:

> 2.8 Limitation on Serving Non-HTML Content

> The Services are offered primarily as a platform to cache and serve web pages and websites. Unless explicitly included as part of a Paid Service purchased by you, you agree to use the Services solely for the purpose of (i) serving web pages as viewed through a web browser or other functionally equivalent applications, including rendering Hypertext Markup Language (HTML) or other functional equivalents, and (ii) serving web APIs subject to the restrictions set forth in this Section 2.8. Use of the Services for serving video or a disproportionate percentage of pictures, audio files, or other non-HTML content is prohibited, unless purchased separately as part of a Paid Service or expressly allowed under our Supplemental Terms for a specific Service. If we determine you have breached this Section 2.8, we may immediately suspend or restrict your use of the Services, or limit End User access to certain of your resources through the Services.

https://www.cloudflare.com/en-gb/terms/

And I am wondering what kind of subscription would be appropriate for my use-case if any, that would allow me to host the files on Backblaze B2, and serve these files through Cloudflare.

(Cloudflare would also be hosting our API, so it’s not just video files that we want to serve via Cloudflare.)

Re:Requests dropped when using Cloudflare’s free tier for a ... by tmikaeld on Monday February 08, 2021 @07:25AM (#26063556)
They do NOT allow video or large files (+50MB) on the Free plan or even on the paid plans!

You'll have to get an Enterprise account for that (it's no longer starting at $5K/mo, you can get custom accounts setup to match your needs).

Re:Requests dropped when using Cloudflare’s free tier for a ... by codetrotter on Monday February 08, 2021 @07:28AM (#26063578)
> it's no longer starting at $5K/mo, you can get custom accounts setup to match your needs

Meaning that it might be possible to get what we need at a suitable price? $5K/mo is way over our budget until we have actual users and revenue.

If so then that is great. Thanks for the tip :)

Re:Requests dropped when using Cloudflare’s free tier for a ... by frankietaylr on Monday February 08, 2021 @09:30AM (#26064900)
They do have a separate offering for video streaming which is pay as you go.

https://www.cloudflare.com/products/cloudflare-stream/

Re:Requests dropped when using Cloudflare’s free tier for a ... by tmikaeld on Monday February 08, 2021 @10:07AM (#26065439)
It's not compatible with Cloudflare Workers afaik.
Re:Requests dropped when using Cloudflare’s free tier for a ... by Sayrus on Monday February 08, 2021 @07:24AM (#26063548)
For what is is worth, I've been using their Free Tier to serve over 10k requests per hour with ~60% html / ~40% media (mainly pictures, very few videos) and I've never had a problem.

However, for a CDN for video content YMMV. Perhaps you should try contacting them directly to have a written estimate.

Re:Requests dropped when using Cloudflare’s free tier for a ... by jimz on Monday February 08, 2021 @08:31AM (#26064149)
I basically have something similar to your use-case. While I'm on the free tier for all my domains, the supplemental agreement, at least in the US version, removes the specific limitation to serve primarily html/text content if you enable Cloudflare Workers, which also has a free tier, applies on an account and not domain level, and has no requirement for you to serve your content through their KV system. I ended up paying for my CF Workers subscription for a different project on my account but the system worked fine prior to that. I served 111GB of a combination of m4a and png files in data from my B2 bucket via CF in the past month.
Re:Requests dropped when using Cloudflare’s free tier for a ... by tmikaeld on Monday February 08, 2021 @08:54AM (#26064424)
Video is really not allowed in the TOS for Cloudflare Workers either, see this discussion about the topic:

https://community.cloudflare.com/t/cloudflare-workers-live-v...

Re:Requests dropped when using Cloudflare’s free tier for a ... by psz on Monday February 08, 2021 @12:15PM (#26067304)
Serving videos (cached or not) is only allowed by using Cloudflare Stream or as a part of Enterprise contract.
Re:Requests dropped when using Cloudflare’s free tier for a ... by philip1209 on Monday February 08, 2021 @07:18AM (#26063503)
Is it possible that this person's free-plan traffic was routed through a POP that was under attack? Then, upon upgrading to Pro the routing rules for the account were modified to avoid under-attack data centers.
Re:Requests dropped when using Cloudflare’s free tier for a ... by pdimitar on Monday February 08, 2021 @08:05AM (#26063885)
I understand you can't share a customer's account details.

But can we at least get an update if this is the intended behaviour of the CF free plan accounts (so people know to upgrade) or is it an one-off incident?

Re:Requests dropped when using Cloudflare’s free tier for a ... by jgrahamc on Monday February 08, 2021 @10:18AM (#26065637)
As I said above, this is not someone hitting a rate limit.
Re:Requests dropped when using Cloudflare’s free tier for a ... by jwr on Monday February 08, 2021 @07:28AM (#26063590)
I think it might also be worth considering whether returning 503 is the right response when rate limited. 5xx indicates server failure, a "429 Rate Limited" is a more appropriate response.
Re:Requests dropped when using Cloudflare’s free tier for a ... by pdpi on Monday February 08, 2021 @08:37AM (#26064232)
4xx is a client error and 429 indicates that particular client is making too many requests. 5xx is a server error and 503 says the service itself is unavailable irrespective of the client’s actions. In this particular case it’d be unavailable for contractual rather than technical reasons, but it’s still the right status
Re:Requests dropped when using Cloudflare’s free tier for a ... by oji0hub on Monday February 08, 2021 @07:41AM (#26063690)
If it is indeed an issue of rate limiting.
Re:Requests dropped when using Cloudflare’s free tier for a ... by dinedal on Monday February 08, 2021 @07:04AM (#26063400)
Regardless of the reason being the limit or not - are these limits published anywhere? It doesn’t appear to be the case.
Re:Requests dropped when using Cloudflare’s free tier for a ... by capableweb on Monday February 08, 2021 @07:07AM (#26063415)
A great first step would be to take responsibility for what the customer has proven to happen. "It is definitively not the case that doing" is directly at odds with what the author provides, you might want to reframe your message to "it shouldn't be like this but unfortunately it is like this right now, sorry" rather than dismissing the author with that they are not correct.
Re:Requests dropped when using Cloudflare’s free tier for a ... by Jamie9912 on Monday February 08, 2021 @07:11AM (#26063441)
You shouldn't assume that he is correct either; i'm a free plan user and have never experienced this
Re:Requests dropped when using Cloudflare’s free tier for a ... by pawurb on Monday February 08, 2021 @07:12AM (#26063449)
If you're on free plan you have no way to know if this has happened to your website.
Re:Requests dropped when using Cloudflare’s free tier for a ... by herendin2 on Monday February 08, 2021 @07:28AM (#26063577)
But, I thought in your case you did know something was wrong: client complained and you saw 503 errors?
Re:Requests dropped when using Cloudflare’s free tier for a ... by avereveard on Monday February 08, 2021 @07:26AM (#26063559)
> no way

you can (and should) put monitors on the outside of your infrastructure as well as inside. I've multiples hitting the login page and robots file where I work, and never got an unaccounted 503

Re:Requests dropped when using Cloudflare’s free tier for a ... by pawurb on Monday February 08, 2021 @07:38AM (#26063671)
Like I wrote, for some integrations it is not possible to gather all the logs. Also how will you know that a client accessing your website in a browser gets 503 instead of your web page?
Re:Requests dropped when using Cloudflare’s free tier for a ... by avereveard on Monday February 08, 2021 @07:58AM (#26063828)
You don't, but your monitors will show the 503 happening, how often, on which endpoint operation and in which regions; that will give you a pretty good picture of whether is actually your CDN layer or something else triggering the 503
Re:Requests dropped when using Cloudflare’s free tier for a ... by buisi on Monday February 08, 2021 @04:19PM (#26070284)
What if it's a specific browser with a specific TLS stack, or something weird?
Re:Requests dropped when using Cloudflare’s free tier for a ... by avereveard on Monday February 08, 2021 @04:59PM (#26070785)
what if it's green lizard man chewing cables?

one has to start somewhere reasonable and realistic first.

Re:Requests dropped when using Cloudflare’s free tier for a ... by jgrahamc on Monday February 08, 2021 @07:13AM (#26063461)
I am taking responsibility for what the customer is reporting here.
Re:Requests dropped when using Cloudflare’s free tier for a ... by Kudos on Monday February 08, 2021 @07:20AM (#26063513)
I think they are taking your use of "would" literally, and not reading it as an implied "should".
Re:Requests dropped when using Cloudflare’s free tier for a ... by oji0hub on Monday February 08, 2021 @07:39AM (#26063678)
Proven is a strong word and rate limiting is not the only possible explanation. Something is happening and we don't know what.
Re:Requests dropped when using Cloudflare’s free tier for a ... by bratao on Monday February 08, 2021 @07:04AM (#26063401)
There is a connection limit???
Re:Requests dropped when using Cloudflare’s free tier for a ... by plasma on Monday February 08, 2021 @03:57PM (#26070010)
I’d look into idle connection handling, I’ve had problems in the past with cloudflare and it’s long open sockets to origin being quietly closed at origin, breaking requests to cloudflare.
Re:Requests dropped when using Cloudflare’s free tier for a ... by goatcode on Monday February 08, 2021 @07:30AM (#26063601)
Please keep us posted. From a naive perspective, what happened has a flavor of "protection fees." A detailed explanation would help quickly dispel this perspective.
Re:Requests dropped when using Cloudflare’s free tier for a ... by jgrahamc on Monday February 08, 2021 @07:32AM (#26063621)
It's going to be hard for me to keep you posted because it would mean discussing a customer's account and I can't do that. That's confidential.
Re:Requests dropped when using Cloudflare’s free tier for a ... by spzb on Monday February 08, 2021 @10:39AM (#26065921)
Hopefully OP will come back and update us
Re:Requests dropped when using Cloudflare’s free tier for a ... by spzb on Wednesday February 10, 2021 @08:15AM (#26088635)
OP's update here : https://news.ycombinator.com/item?id=26072153

TLDR; He's retracted his claims