News for hackers. Stuff that matters.
Re:Feed readers which don't take "no" for an answer by that_guy_iain on Sunday December 22, 2024 @10:18AM (#42486849)
If you understand what rate limiting is, you block them for a period of time. Let's stop being pedantic here.

72 requests per day is nothing and acting like it's mayhem is a bit silly. And for a lot of people would result in them getting possible news slower. Sure OP won't publish that often but their rate limiting is an edge case and should be treated as such. If they're blocked until the next day and nothing gets updated then the only person harmed is OP for being overly bothered by their HTTP logs.

Sure it's their server and they can do whatever they want. But all this does is hurts the people trying to reach their blog.

Re:Feed readers which don't take "no" for an answer by HomeDeLaPot on Sunday December 22, 2024 @10:40AM (#42486988)
72 requests per day _per user with a naive feed reader_. This is a small personal blog with no ads that OP is self-hosting on her own hardware, so blocking all this junk traffic is probably saving her money. Plus she's calling attention to how feed readers can be improved!
Re:Feed readers which don't take "no" for an answer by that_guy_iain on Sunday December 22, 2024 @11:50AM (#42487488)
Even if they had 1000 feed readers which would be a massive amount for a blog, if you can't scale that cheaply, that's on you.

As I pointed out, her blog and rate limiting are an extreme edge case, it would be silly for anyone to put effort into changing their feed reader for a single small blog. It's bad product management.

Re:Feed readers which don't take "no" for an answer by tecleandor on Sunday December 22, 2024 @11:56AM (#42487528)
Of course she can. It's static. She doesn't want and I understand. She's signaling their clients an standard call to say "I think you already have read this, at lest ask me first when this changed the last time".
Re:Feed readers which don't take "no" for an answer by that_guy_iain on Sunday December 22, 2024 @06:06PM (#42489940)
If you choose to run a poorly implemented rss feed and not scale it cheaply you lose any sympathy from me.
Re:Feed readers which don't take "no" for an answer by EdwardDiego on Monday December 23, 2024 @07:26AM (#42493906)
So long as you know what If-Modified-Since is, and use it, you can have all or none of the sympathy you want.
Re:Feed readers which don't take "no" for an answer by m3047 on Sunday December 22, 2024 @01:12PM (#42488031)
My reason for smacking stuff down is that I don't want to see it in my logs. That simple.
Re:Feed readers which don't take "no" for an answer by quest88 on Sunday December 22, 2024 @10:59AM (#42487125)
I invite you to run your own popular blog on your own hardware and pay for the costs. It sounds like you don't know what the true costs are.
Re:Feed readers which don't take "no" for an answer by donatj on Sunday December 22, 2024 @11:05AM (#42487165)
I do run a popular blog, and a $5 a month Digital Ocean droplet handles millions of requests per month without breaking a sweat.
Re:Feed readers which don't take "no" for an answer by devjab on Sunday December 22, 2024 @11:14AM (#42487230)
If every user is collecting 36mb a day like in the story here, your droplet wouldn’t even be capable of serving 500 users a month without hitting your bandwidth limit. With their current rates, your one million requests would cost you around 10 million USD.
Re:Feed readers which don't take "no" for an answer by donatj on Sunday December 22, 2024 @11:34AM (#42487370)
30 * 500 * 36mb = 560gb and I have 1tb a month on my apparently $6 droplet

Correction - from my billing page it's $4.50 a month, from the resize page it is $6 so I'm guessing I am grandfathered in to some older pricing

Re:Feed readers which don't take "no" for an answer by tecleandor on Sunday December 22, 2024 @11:58AM (#42487542)
That's ridiculously big quantity of data to serve a seldomly updated blog just because the client doesn't want (or know how, or think about) to implement an easy and old http method.

Imagine the petabytes of data transferred through the internet saved if a couple RSS clients added that method.

Re:Feed readers which don't take "no" for an answer by sccxy on Sunday December 22, 2024 @11:23AM (#42487288)
If OP enabled gzip then this 36mb would be 13mb.

If OP reduced 30 months of posts in rss to 12 months then this 13mb would be 5mb a day.

Using Cloudflare free plan and this static content is cached without any problem.

Re:Feed readers which don't take "no" for an answer by notpushkin on Sunday December 22, 2024 @10:44PM (#42491562)
Yeah, but also... if RSS readers behaved correctly, it would be 512 kb. (170 kb with gzip, if she didn't enable it like you imply – I'm too lazy to check, but I assumed it was on.)

I think making clients behave correctly is much more sustainable solution, although we could do better than doing so at the cost of the end users.

Re:Feed readers which don't take "no" for an answer by int_19h on Tuesday December 24, 2024 @07:18PM (#42505952)
This entire thread is a vivid illustration of why software is so shitty in general these days.
Re:Feed readers which don't take "no" for an answer by Twirrim on Sunday December 22, 2024 @11:19AM (#42487265)
OP has never said that this is about financial aspects of things.
Re:Feed readers which don't take "no" for an answer by Joker_vD on Sunday December 22, 2024 @12:46PM (#42487891)
Yews, it's about enforcing their preference on how others should interact with OP's published site feed, on principle. Which is always an uphill battle.
Re:Feed readers which don't take "no" for an answer by Twirrim on Monday December 23, 2024 @02:01AM (#42492406)
It's about enforcing that people follow standards. Which is still an uphill battle, but at least it's based in something sane. Their work on this has resulted in improvements to a whole slew of popular feed readers that should make life easier for a chunk of the internet, not just OP's own site.
Re:Feed readers which don't take "no" for an answer by that_guy_iain on Sunday December 22, 2024 @11:04AM (#42487154)
Sounds like you don't know how to scale for cheap.

And since I've ran integrations that connected over 500 companies. I know what a rouge client actually looks like and 72 requests per day and I wouldn't even notice.

Re:Feed readers which don't take "no" for an answer by EdwardDiego on Monday December 23, 2024 @07:27AM (#42493910)
Good on you champ.
Re:Feed readers which don't take "no" for an answer by sccxy on Sunday December 22, 2024 @11:06AM (#42487169)
More like a skill issue or just decision to make your life more difficult.

It is free and easy to scale this kind of text based blog.

Re:Feed readers which don't take "no" for an answer by EdwardDiego on Monday December 23, 2024 @07:28AM (#42493914)
> More like a skill issue

Hey, I think you mistook HN for Reddit.

Re:Feed readers which don't take "no" for an answer by omgtehlion on Monday December 23, 2024 @02:58AM (#42492680)
I serve 30tb/month for $30/mo on my own colocated hw
Re:Feed readers which don't take "no" for an answer by throw0101b on Sunday December 22, 2024 @10:43AM (#42487010)
> 72 requests per day is nothing and acting like it's mayhem is a bit silly.

72 requests per day per IP over how many IPs? When you start multiplying numbers together they can get big.