News for hackers. Stuff that matters.
Re:[418] I'm a Teapot by geuis on Saturday May 27, 2023 @01:58AM (#36092417)
Many years ago, some person misconfigured their squid proxy and was hitting https://jsonip.com to the point my server at the time was turning green in the gills.

I started responding with 418 "You are a tea kettle" or something like that to those specific requests. The originating dev actually paid attention to their error messages and quickly resolved their config issue.

Fast forward to March this year. Some fucking numb nuts a-hole decided to add jsonip.com to an EXTREMELY widely used version of Dalvik/Android software that gets deployed to hundreds of thousands or millions of devices.

Overnight my traffic levels increased by 300%. I'm a solo dev offering a free service for 12 years. That kind of increase in traffic costs me money I've never had to plan for.

I ended up switching to Cloudeflare to handle the load with a WAF filter on the offending android tvs and other devices.

However Cloudflare doesn't properly route ipv4 address because "ipv6 is cool so we only do that" or something. Despite numerous support requests, that's still shmaybe an enterprise level feature.

I apologize to any long time users of the service. This was completely unexpected after more than a decade. I've been trying different "fixes" for 2 months and have not resolved a way to block this garbage traffic and still provide the original services.

Yea sorry I turned this funny old internet post about the mit coffee pot into a thing happening to me.

But if for some ungodly reason you're the dev or know who did it, REMOVE MY SERVICE ADDRESS FROM YOUR OUT OF DATE FROM TV/SMART DEVICE ANDROID code. You're literally fucking killing me. I've literally spend dozens of hours trying to find out if this was a contribution to a public source repo. Nothing.

Based on the Dalvik user agent, I only found a handful of references in Chinese repos. But google search is so terrible these days, even those are false flags.

So I have no idea who to contact about this. Some dipshit on your team(s) decided to abuse a free service as though there isn't a single human person behind it absorbing the costs and making sure it runs.

Re:[418] I'm a Teapot by mrweasel on Saturday May 27, 2023 @02:34AM (#36092557)
Could you start returning wrong answers, "country":"TW" should do it.

We had to deal with image scrapers who didn't respond to requests to stop, even if we provided an API service. I configured nginx to just serve them images of a beaver and a few 1GB junk files, they stopped pretty quickly.

Re:[418] I'm a Teapot by ozr on Saturday May 27, 2023 @02:15AM (#36092477)
You're a better person than me. I'd start returning nonsense like `999.9` to see if I could trigger a ton of bug reports for someone.
Re:[418] I'm a Teapot by lloeki on Saturday May 27, 2023 @06:32AM (#36093562)
other evil ideas:

- return a 200 with broken JSON, possibly triggering parse errors or exceptions in the caller

- return a payload that generates catastrophic resource consumption on the other end, e.g Content-Encoding: gzip and feed it a deflate bomb

- hack TCP and/or TLS to leave the other end waiting/stalling in an attempt to rate limit (timeout) or starve resources (ulimit) on the other end (e.g abuse 3 way handshake)

Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @09:05AM (#36094483)
The site advertises itself as free for all and unlimited usage. To suddenly return malicious responses to intentionally break these apps might very well be illegal in many countries, or maybe would make them liable for damages claims. These clients are not violating any TOS or doing anything not allowed, after all.
Re:[418] I'm a Teapot by lloeki on Saturday May 27, 2023 @10:16AM (#36095001)
I said "evil" for a reason.

That said, it seems like a _single_ actor is causing 300% cost increase compared to _every other actor combined_. Even if advertised as free, there's decency to be had.

If I lend someone my home without TOS and say "make yourself at home" there's a reasonable common sense expectation from both parties that visitors should not turn on every water tap and electric device full blast 24/7, because that would be damaging to me in the first place.

Given the scale of the purported app causing this it's very much abuse in its own right, whether intentional, misengineering, or an oversight. The author of jsonip.com seems to have taken every precautionary measure to limit damage and identify perpetrators to reach out, and these failed. Ethically I feel it would be only fair to displace damage from their infra to the app in order to protect themselves. The only alternative is to shutter the service as it's essentially experiencing a financial DDoS.

Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @10:33AM (#36095141)
> there's a reasonable common sense expectation

Your logic error is in assuming all people have common sense and setting expectations based on that assumption.

This actually has nothing to do with common sense, a jr and sometimes even senior mobile devs would not have the mindset of avoiding a ddos to a third party api when writing a feature that needs to get the device ip. It wouldn't be on purpose, it would just be that they don't know that they don't know yet. These issues of slamming a backend server are pretty common and mobile devs don't know to avoid it until they cause it imo. This could also be malware too which wouldn't care about decency.

Point is, scale your service, adjust your terms, start rate limiting, or shut it down. Calling your users names is the wrong solution no matter the user's intent, and solves exactly zero of the issues at hand.

The service owner should feel proud to have such a popular service, many folks will never have to deal with scaling issues. As the saying goes "scaling issues are good issues to have".

Re:[418] I'm a Teapot by pksebben on Saturday May 27, 2023 @12:01PM (#36095788)
> Calling your users names is the wrong solution no matter the user's intent, and solves exactly zero of the issues at hand.

True, but returning fire with malformed responses or other such tactics could absolutely solve:

> assuming all people have common sense

.. sometimes effective communication starts by doing what you have to IOT get someone’s attention.

Re:[418] I'm a Teapot by lloeki on Saturday May 27, 2023 @04:08PM (#36097776)
> scale your service

Scaling is done entirely at the expense of the service provider, so, not a sustainable option (and AIUI already done so as to continue serving for other users, but at terrible cost). Scaling issues are good to have when you have customers, not when you personally foot the bill.

> adjust your terms

At the very least changing terms won't change the already deployed app instances. In each of the three delineated scenarios it won't even register a blip on the abuser radar. So, not an option.

> start rate limiting

Pretty sure that was attempted. This is DDoS, rate limiting means doing it across the board, impacting every user, including those in good standing.

> or shut it down.

The only effective option. a.k.a the nuclear option a.k.a We Can't Have Nice Things.

> get someone's attention

That's the end game of these gray tactics. Not wreaking havoc but triggering awareness in a last resort way so that dialog can be opened/corrective measures can be taken. Note that "shut it down" would presumably have a similar effect, so there's no real harm done in practice.

Re:[418] I'm a Teapot by leobg on Saturday May 27, 2023 @10:18AM (#36095020)
Why? There is no guarantee give to victimize that service for free forever.
Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @10:58AM (#36095329)
There's a huge difference between blocking traffic to keep your servers online (you are the good guy) and returning payloads that are intended to break consuming services (you are the bad guy, performing a premeditated malicious act on unsuspecting devices, across state lines)
Re:[418] I'm a Teapot by leobg on Saturday May 27, 2023 @12:48PM (#36096146)
Maybe. Sorry for the auto correct.
Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @09:34AM (#36094697)
One could always do a 301 to some other ip service like icanhazip.com and make it their problem, if one were so inclined
Re:[418] I'm a Teapot by dannyw on Saturday May 27, 2023 @02:22AM (#36092503)
Your website on https://getjsonip.com/ says:

> Supports unlimited requests and is free.

Maybe update that text? There is no guidance on acceptable thresholds, rate limits, etc.

Re:[418] I'm a Teapot by d0ugal on Saturday May 27, 2023 @02:47AM (#36092592)
That appears to be a different URL
Re:[418] I'm a Teapot by 8organicbits on Saturday May 27, 2023 @04:51AM (#36093102)
One is a marketing and docs site, the other is the "api".
Re:[418] I'm a Teapot by geuis on Saturday May 27, 2023 @02:47AM (#36092595)
Yeah I know. That is a legit critique. What's been happening is your essential black swan event. I've been running the service for 12 years and have never had this problem. There are hundreds of websites and independent users that have never abused the api like this until March. I have always been able to absorb the traffic impact.

This is different. Someone wasn't thinking and randomly added the domain to a lazy piece of code somewhere that got deployed to millions of devices pretty much over night. The only way I've been able to keep jsonip active is by incorporating Cloudflare. But they don't actually solve the problem. As a corporation, they treat ipv4 addresses like 3rd class citizens.

Anyway yeah I've been evaluating changing the TOS, requiring registered signins, etc. But NONE of those fixes a 300% level of traffic that's been hitting the service for months now. I can change the verbiage all I want. But it does absolutely nothing to stop the a-hole dev from China or wherever that rolled out an update to hundreds of thousands of millions of devices with simply emailing me if that's ok.

I've literally, and successfully, run the service for free to the public because no one has done this before.

And to the nginx people. No, returning 444 doesn't seem to fix the problem. I've tried. It doesn't work.

Re:[418] I'm a Teapot by bierjunge on Saturday May 27, 2023 @03:20AM (#36092731)
Unethical tip: start returning the content of this article [0] to these devices. The Chinese government will "fix" the devs for you or simply block all traffic to your site.

[0] https://en.wikipedia.org/wiki/1989_Tiananmen_Square_protests...

Re:[418] I'm a Teapot by pabs3 on Saturday May 27, 2023 @05:07AM (#36093175)
Or geolocate Chinese IPs to Taiwan.
Re:[418] I'm a Teapot by moffkalast on Saturday May 27, 2023 @05:43AM (#36093343)
What a big brain move, that might actually work. Unless of course the devices are being sold abroad.
Re:[418] I'm a Teapot by wiseowise on Saturday May 27, 2023 @06:48AM (#36093628)
How’s that unethical?

Love it.

Re:[418] I'm a Teapot by bierjunge on Saturday May 27, 2023 @07:08AM (#36093729)
Unethical because it can get the devs into legal trouble and the Chinese government is known to be aggressive in their choice of "solutions".
Re:[418] I'm a Teapot by nitrammm on Saturday May 27, 2023 @05:16AM (#36093234)
If you explicitly tell some junior software developer in China that he can call an API for free an unlimited number of times, then afterwards calling it abuse and him and a-hole dev is definitively a bit of an a-hole thing to do in my view.
Re:[418] I'm a Teapot by wiseowise on Saturday May 27, 2023 @06:50AM (#36093635)
It says that you can call it unlimited number of times, not millions of devices that you’re selling.
Re:[418] I'm a Teapot by KomoD on Saturday May 27, 2023 @07:36AM (#36093868)
Last I checked unlimited is more than millions
Re:[418] I'm a Teapot by junon on Saturday May 27, 2023 @08:08AM (#36094042)
This mindset is why we need "do not use while sleeping" warning labels on toasters and hair dryers.
Re:[418] I'm a Teapot by nitrammm on Saturday May 27, 2023 @09:33AM (#36094693)
This would be very valid comment if toasters had manuals telling that they are perfectly safe to use while sleeping.

If you lie in your marketing material then you may put yourself in a mess. Big surprise.

Re:[418] I'm a Teapot by KomoD on Saturday May 27, 2023 @01:44PM (#36096637)
No, advertising unlimited and then complaining when someone truly does use unlimited is not a problem with my mindset, it's a problem with the person who runs the service, if you don't want people to truly use unlimited, don't advertise unlimited.
Re:[418] I'm a Teapot by wiseowise on Saturday May 27, 2023 @08:28AM (#36094175)
Sure, you specifically can use it million times, or even more (given your span of life).

If your audience is millions of users it’s millions * millions, not cool.

Re:[418] I'm a Teapot by nitrammm on Saturday May 27, 2023 @09:36AM (#36094719)
So if someone doesn't undeestand this assumption, then they are an asshole?

That's pretty crazy viewpoint.

Re:[418] I'm a Teapot by wiseowise on Saturday May 27, 2023 @04:32PM (#36098015)
> So if someone doesn't undeestand this assumption, then they are an asshole?

Yes.

> That's pretty crazy viewpoint.

Companies that make millions of devices while abusing free APIs without giving anything back are assholes. Hmm, let me think?

No, it’s not.

Re:[418] I'm a Teapot by nitrammm on Sunday May 28, 2023 @03:55AM (#36102055)
You must be living in a bubble if you think that's how companies operate.

Saying that someone is an asshole for using an API in a way which clearly should be possible according to the documentation is a very clear sign of that person being a junior developer who don't have actual real world experience of anything except toy projects. Any developer with some years of experience would understand that this would happen and he should not be surprised over it.

It's very possible that no one involved in this is even aware of this issue, so automatically calling them assholes is somewhat incompetent at best.

Re:[418] I'm a Teapot by KomoD on Sunday May 28, 2023 @07:44AM (#36103193)
> Companies that make millions of devices while abusing free APIs without giving anything back are assholes.

If a service is free & "unlimited" and they start using it, and you get mad, then that is not their fault, it's yours.

Re:[418] I'm a Teapot by nitrammm on Saturday May 27, 2023 @07:21AM (#36093787)
It says:

> Supports unlimited requests and is free.

Typically "unlimited" is more than a million.

Re:[418] I'm a Teapot by wiseowise on Saturday May 27, 2023 @08:30AM (#36094187)
Water in a lake is also technically free (depending on local laws), do I have to make it clear that inviting millions to take a cup out of it is not a good idea?
Re:[418] I'm a Teapot by nitrammm on Saturday May 27, 2023 @08:39AM (#36094257)
This is the internet? If there are a million people around the lake fond of tea then of course you need to tell them that they can't consume all the water. Offering a free service and being upset when people use it is just naive.
Re:[418] I'm a Teapot by Dudeman112 on Saturday May 27, 2023 @07:57AM (#36093969)
There's always an individual with autism-level consideration for what one says, isn't there?

No, effectively DDOS-ing a service just because it says it's free and unlimited is a dick move

People like those are a big reason for why we can't have nice things

Re:[418] I'm a Teapot by nitrammm on Saturday May 27, 2023 @08:43AM (#36094295)
To me it just screams naivety to put up a free service, advertise it as unlimited and then calling people asshole when they make too many requests.

Personally I would never rely on a service like this since it's 100% obvious it would be sudpectible to junior developers misunderstanding what is reasonable usage.

If you're putting up an API assuming all consumers will consume it in some limited and reasonable way, then you need to rethink things a bit.

Re:[418] I'm a Teapot by corobo on Saturday May 27, 2023 @08:43AM (#36094297)
> There's always an individual with autism-level consideration for what one says, isn't there?

What does this sentence even mean lmao

Autism-level consideration for what one says or not, if you say something is unlimited I'm going to take your word for it. If it's limited, tell me the limits. If it's free to a point, tell me the point. If I need to bust out the CC, tell me I need to bust out the CC.

Don't say your thing is free and unlimited if you can't handle unlimited traffic for free..

Hacker News would be on the complete opposite end of the anger scale if this was an ISP telling their users they can't actually use the "unlimited" they promised, haha

Re:[418] I'm a Teapot by Dudeman112 on Saturday May 27, 2023 @09:58AM (#36094885)
>What does this sentence even mean lmao

>if you say something is unlimited I'm going to take your word for it

The sentence refers to people like you. It doesn't make you incredibly clever to consider those sentences literally, like small children or those with under-developed empathy and theory of mind often do

It just makes you an inconsiderate numpty

>Hacker News would be on the complete opposite

Yes, there are lots of people on the tech scene that just don't get ideas like "don't abuse it", or "considering the consequences for other people"

Re:[418] I'm a Teapot by nitrammm on Saturday May 27, 2023 @10:09AM (#36094963)
> Yes, there are lots of people on the tech scene that just don't get ideas like "don't abuse it", or "considering the consequences for other people"

Got to love the cleverness with the people who design services with the assumption that there are no such people and then goes on to hackernews and cries when a kid in China breaks their site. Lol.

Insanely incompetent.

Re:[418] I'm a Teapot by corobo on Saturday May 27, 2023 @11:03AM (#36095382)
> Yes, there are lots of people on the tech scene that just don't get ideas like "don't abuse it", or "considering the consequences for other people"

It's not abuse if you say it's free and unlimited and someone uses it freely and unlimitedly! This is why sites have acceptable use policies and terms of service. This is why most sites don't say their tool is free and unlimited.

It is what those words mean. It is literal. If I read an acceptable use policy and then went on to use it in a way that is not allowed that would be silly.

> The sentence refers to people like you

> It just makes you an inconsiderate numpty

Speaking of "like small children or those with under-developed empathy and theory of mind", I'm not sure these were needed. Can we just discuss things? I promise my mind is open whether you insult it or not, I'm just not convinced by the argument at this point :)

I hope you got a nice slither of dopamine out of namecalling though in any case, haha

Re:[418] I'm a Teapot by Dudeman112 on Sunday May 28, 2023 @04:17AM (#36102142)
>It is what those words mean. It is literal.

>I'm not sure these were needed

The original wording I was gonna use before deciding to be more considerate was "small children and autists"

If you can think of another short descriptor for "people who obtusely take things literally and are unable or refuse to account for other people's state of mind", I'm happy to use those instead

>I hope you got a nice slither of dopamine out of namecalling though in any case

In fact, it was far more than a sliver!

Upon further reflection, I think I got a lot of repressed anger for never having smacked people who can't behave unless they are explicitly told to do so, who actually need the "within reason" clause everywhere, and who are happy to play with technicalities when it comes to justifying their behaviour

Re:[418] I'm a Teapot by corobo on Sunday May 28, 2023 @01:57PM (#36106243)
You do make an aggressively fair point. I've also enjoyed the banter if nothing else :)

I dunno if my mind is changed just yet but if I'm honest with myself adding it to a widely deployed app would be in my 'dick move' category.

Just set your own up, or use a DNS method which comes with the bonus of built in caching.

For what it's worth I've never actually taken anyone up on their unlimited offers, I try to keep my services neat and tidy :)

Re:[418] I'm a Teapot by tentacleuno on Sunday May 28, 2023 @06:13AM (#36102731)
In the context of an ISP, what is abuse in terms of network usage? For instance, I'm sure with console + PC gaming etc. a lot of gamers use around 400GB a month on average. Systems evolve, and it's the ISPs' job to keep up with demand.
Re:[418] I'm a Teapot by endominus on Saturday May 27, 2023 @09:13AM (#36094543)
Relevant SMBC (especially to the sibling comments, holy shit): https://www.smbc-comics.com/?id=2095
Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @10:06AM (#36094942)
Think of your average engineer doing mobile development. "Here, hit this url to get the device ip". They write the code, it makes 1 request. The average backend engineer isn't performance focused, why would the average mobile engineer be thinking about a distributed denial of service against some third party api? Most mobile engineers have to be guided to not slam their own backend servers, and do not approach problems in their sphere with the mindset to prevent this type of issue. Not knocking mobile devs, it's just literally not something they have to care about most of the time, and imo only the ones who go out of their way to have a solid understanding of the backend systems would even understand what's in play here

Besides that, odds are that this is malware of some sort hitting this service to get the infected device's public ip to phone it home for use in a command and control situation, and if so, they don't care that they are slamming this service.

Mobile devs who care about this type of thing will not need to make any sort of outbound connection anywhere to get the device ip address, it's right on the device already. These what's my ip sites are used by script kiddies and malicious software running on anything

"There's always an individual with autism-level consideration for what one says, isn't there?" isn't needed and I'd advise you to be more professional, or at least more human.

Re:[418] I'm a Teapot by ricardobayes on Saturday May 27, 2023 @10:49AM (#36095266)
Can you imagine a fast food restaurant franchise CEO to complain how annoying it is that people ask for copious amounts of free ketchup? If you don't have a policy or anti-abuse measures, don't complain that "people are using too much" of the free stuff. That's ridiculous and detached from real life.
Re:[418] I'm a Teapot by crote on Saturday May 27, 2023 @12:50PM (#36096174)
That one random guy asking for ten or twenty packets of ketchup every once in a while isn't the problem. Sure, it's weird, but he does put it all on his fries and he does eat it all, so that's just part of offering free ketchup.

However, would you still call it "detached from real life" if suddenly the manager from McDonalds starts showing up daily, filling a 100-gallon drum with ketchup because it is "free"? In law there is such a concept as a "reasonable person", which exists precisely to avoid people abusing loopholes like this.

Re:[418] I'm a Teapot by hnfong on Saturday May 27, 2023 @11:00PM (#36100767)
I scanned through the comments and I don't think anyone raised the possibility that the developer might not be aware how many devices their code would be running on.

It's quite possible that a random just contracted to write software for some embedded system, with no context how many thousands or millions of devices it would run on. So they looked up OP's site, sees "supports unlimited requests and is free", shrugs and just writes implements the code.

Or, the dev might be told the system only had a couple thousand users, then somebody else copied the code and deployed it on a million devices.

You don't know the story, and I think the moral here is not to blame a faceless Android dev from China, but to implement quotas and controls and avoid falsely boast on your website that your service has unlimited scalability.

Re:[418] I'm a Teapot by CPLX on Saturday May 27, 2023 @07:42AM (#36093893)
Do you have a way to donate?
Re:[418] I'm a Teapot by maccard on Saturday May 27, 2023 @09:12AM (#36094531)
> The only way I've been able to keep jsonip active is by incorporating Cloudflare. But they don't actually solve the problem. As a corporation, they treat ipv4 addresses like 3rd class citizens.

Don't get me wrong, you're doing the world a service with your service, but why should cloudflare have to handle your problem for free? If you want to resolve your problem, it sounds like it's in your hands - block traffic, or us something like cloudflare/waf. It's not fair that you have to eat the cost, but it's not fair that someone else does either.

Re:[418] I'm a Teapot by geuis on Saturday May 27, 2023 @02:36PM (#36097076)
Oh, I never expected Cloudflare to handle the problem for free. I would happily have at least a pro level account with them if they treated ipv4 traffic properly. But they don't expose a request's actual v4 address to the backend. The WAF works amazingly well, but it otherwise breaks a critical part of the service.
Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @10:20AM (#36095029)
> rolled out an update to hundreds of thousands of millions of devices with simply emailing me if that's ok.

If it's malware, they don't care if it's ok, they are malware authors. Contact your hosting provider which 100% has the ability to offload traffic from malware and ddos. They are responsible for the network and will not want malicious traffic anywhere on it. They will move on it quick if so, and at the least can examine the traffic to determine if it's bad or not.

Cloudflare won't do much good here no? The requests still have to proxy back to your origin servers to spit back the ip. You can't utilize any caching on cloudflare due to the unique ip of each client. Their ddos prevention might not help because these are clients each with their own unique ip address, which is probably a cellular provider's ip space and not bad traffic. If it's the volume of clients hitting you, and not the volume of requests they make, it wouldn't trip cloudflare, or they'd be blocking major cellular address space across their entire network (which is a large portion of the internet these days)

Re:[418] I'm a Teapot by takenpilot on Saturday May 27, 2023 @02:21AM (#36092497)
Re:[418] I'm a Teapot by Dalewyn on Saturday May 27, 2023 @02:12AM (#36092468)
>as though there isn't a single human person behind it absorbing the costs and making sure it runs.

Obligatory https://xkcd.com/2347/

Re:[418] I'm a Teapot by geuis on Saturday May 27, 2023 @02:48AM (#36092603)
You are a legend. Many hugs.
Re:[418] I'm a Teapot by pkphilip on Saturday May 27, 2023 @02:48AM (#36092598)
Sorry but I laughed aloud at all the swearing! But yes, I empathise complelely with your situation. People abusing someone else's free service really gets my goat. I hope this situation is resolved soon.

I do agree with one of the other comments - returning something about Taiwan or Tiannenmen square may do the trick

Re:[418] I'm a Teapot by ricardobayes on Saturday May 27, 2023 @03:42AM (#36092814)
No, sorry this is 100% on you. You should have implemented throttling, and daily query limits. Once you put something on the internet for free, you can't complain then if people are using it.
Re:[418] I'm a Teapot by usrbinbash on Saturday May 27, 2023 @04:29AM (#36093020)
> you can't complain then if people are using it.

Yes he can complain, and bombarding a free service for unlimited requests isn't okay.

For starters because the people doing that, will usually be among the first to cry when the free service stops being free, blocks their requests or suddenly requires an API key.

Re:[418] I'm a Teapot by ranguna on Saturday May 27, 2023 @04:37AM (#36093050)
> bombarding a free service for unlimited requests isn't okay

Hummmm.... OP's website on https://getjsonip.com/ says:

> Supports unlimited requests and is free.

Seems like we have a bit of a contradiction here.

Re:[418] I'm a Teapot by usrbinbash on Saturday May 27, 2023 @04:52AM (#36093114)
I see no contradiction.

There is a difference between gracefully and responsibly using something that is offered for free, and just bombarding it with requests like no tomorrow.

People can of course do the latter. But then they don't get to complain when at some point, the available offerings present walls of legalese instead of a few simple and clear statements, and the user experience goes from seamless and easy to "Click here to register an API Key"

Re:[418] I'm a Teapot by ranguna on Monday May 29, 2023 @04:18AM (#36111869)
It all depends on the nature of the work you are doing.

One thing is to own a service that's used by 10 MAU and you extend the service with a job that calls the OP's service 100 times a second. That's bad, you are using way more than you need.

Another thing is to own a mobile app used by 10M MAU and you embed the OP's service into the app. That's not bad intention, you just added a new service to your app. The problem is that the OP's definition of "unlimited" is not really unlimited.

Re:[418] I'm a Teapot by srvmshr on Saturday May 27, 2023 @06:59AM (#36093685)
No that is not why OP had set up the server. It was gratis. A complementary service. It was supposed to be used responsibly, since it seems evident that this isn't sponsored by some corporate. For a hobby project hosted on their own dime, it was okay for fair use. If this was something a dev needed for their business, self-hosting it (if FOSS) or licensing it from the creator was the right thing, so that OC didn't have to bear the burden.

Imagine a local hobby meetup giving free ice cream at the venue. Just because someone liked it and it was free, didn't allow them to invite over all their siblings, kith and kin, brethren and the entire ancestral village.

Re:[418] I'm a Teapot by revolvingocelot on Saturday May 27, 2023 @09:10AM (#36094516)
Back in highschool, my friends and I got kicked out of a buffet restaurant. Every movie I've ever seen a poster for suggests that it's "Only in Theatres", yet I've held many a DVD release in my hands.

There's something about reasonability and fair-use and use over time going on here, but I just can't put my finger on it.

Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @10:51AM (#36095279)
You didn't get kicked out, you got played. They bank on the fact that most people will eat less than the price of admission, kinda almost like the ones who under eat the admission cost subsidize the ones who overeat the admission cost. Kinda like the paying customers for a service usually subsidize the running costs of the free tier. The buffet advertised all you can eat, you paid them, that's a contract. Unless there's fine print that you agreed to, you had no obligation to leave before you had your fill if they were open still. America 101, contracts and liability for breaches of contracts.

For example here's the Backblaze team verifying that their unlimited personal backup is indeed unlimited, with one single user storing 430TB for $6/month. The users spending $6/month who use a couple GB more than offset the cost of the 430TB guy. If your business model doesn't support the ability to get in the black, you have a failing business. This isn't the user's responsibility to fix, it's the failing service with a bad business model.

> As you can see, we lose money on a few customers at the high end (we cannot store 430TB of data for only $6/month), but since more customers just want to be reasonable and backup their laptops we are profitable and fully sustainable on the "average"

> Somebody who is costing Backblaze $2,150/month and is only paying $6/month :-)

https://www.reddit.com/r/IAmA/comments/b6lbew/comment/ejlbsq...

Re:[418] I'm a Teapot by Prickle on Monday May 29, 2023 @04:29AM (#36111944)
You can say that the local community water well has "unlimited uses", then complain when Nestle comes over and takes all the water.

No difference here.

Re:[418] I'm a Teapot by ricardobayes on Saturday May 27, 2023 @10:46AM (#36095241)
Can you imagine a fast food restaurant franchise CEO to complain how annoying it is that people ask for copious amounts of free ketchup? If you don't have a policy or anti-abuse measures, don't complain that "people are using too much" of the free stuff. That's ridiculous and detached from real life.
Re:[418] I'm a Teapot by misnome on Saturday May 27, 2023 @04:09AM (#36092937)
You absolutely can. Nobody has an obligation to serve you if you are an asshole.
Re:[418] I'm a Teapot by johnisgood on Saturday May 27, 2023 @04:18AM (#36092976)
Why complain instead of mitigating? Or why not complain AND mitigate at the very least?

Do not serve it to assholes?

Re:[418] I'm a Teapot by misnome on Saturday May 27, 2023 @04:28AM (#36093016)
> Or why not complain AND mitigate at the very least?

You mean, like they say they have been trying to do, in the complaint?

Re:[418] I'm a Teapot by johnisgood on Saturday May 27, 2023 @08:16PM (#36099832)
I am replying to you saying that "you absolutely can [complain]". The comment to which I replied simply states that you can complain. Sure, you can. shrugs
Re:[418] I'm a Teapot by wiseowise on Saturday May 27, 2023 @06:58AM (#36093673)
I’ll never understand “no complain” argument.

Person has a valid complaint, goddamnit, they have all the rights to complain.

Re:[418] I'm a Teapot by johnisgood on Saturday May 27, 2023 @08:15PM (#36099817)
Sure, feel free to complain away if that makes you feel better.
Re:[418] I'm a Teapot by CPLX on Saturday May 27, 2023 @07:44AM (#36093900)
I mean, we've all got a right to grievances.
Re:[418] I'm a Teapot by GuB-42 on Saturday May 27, 2023 @08:34AM (#36094224)
I would have agreed if it was a piece of source code. For example if you put a bit of code on the internet using a permissive license and it is good, don't complain that some tech giant took all your work for themselves without giving you anything in return. By choosing that licence you explicitly told the world that doing this is fine. Also, using someone else source code doesn't incur recurring costs on the author's part.

But here, you are actually taking resources from the author. That's something that is not only rude, but also puts the user at risk. The author is really nice for maintaining service, he could have just stopped it, or even served malicious payloads. After all, there is no contract saying that he should be nice. Here, despite the strong language, he is trying to stay nice instead of just cutting a service that many people rely on, which he has all right to do.

Throttling and daily query limits would make the service unreliable and not so different from cutting it off completely. Keep in mind that it is not a single user abusing the service, it is many users who got redirected there by an abusive app. He could have used the "API key" that is suggested here, but it is a hurdle that will affect usability.

Re:[418] I'm a Teapot by ricardobayes on Saturday May 27, 2023 @10:42AM (#36095202)
Yeah maybe, but in this day and age it's completely unreasonable to expect anything from users. You need to expect the worst and if your system is not prepared for it, then sorry, it's badly designed. There are many anti-abuse measures and if you're deliberately not using any of them, then that's on you.
Re:[418] I'm a Teapot by gnfargbl on Saturday May 27, 2023 @03:59AM (#36092886)
Unfortunately, this seems to be the pattern that people offering the same service as you experience.

Take a look at https://major.io/2021/06/06/a-new-future-for-icanhazip/, if you haven't seen it already.

Re:[418] I'm a Teapot by geuis on Monday May 29, 2023 @03:53AM (#36111744)
Thanks for the link. That's like reading something from a really scary personal future.
Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @04:01AM (#36092901)
icanhazip.com had similar issues. Cloudflare took over the project https://major.io/2021/06/06/a-new-future-for-icanhazip/

Fyi, dns can be used to obtain public ip from large companies, without the overhead of tcp and http

dig +short txt ch whoami.cloudflare @1.0.0.1

dig +short txt o-o.myaddr.l.google.com @ns1.google.com

dig +short myip.opendns.com @resolver1.opendns.com

Re:[418] I'm a Teapot by KomoD on Monday May 29, 2023 @12:23PM (#36115388)
What does the "ch" mean?
Re:[418] I'm a Teapot by Mandatum on Saturday May 27, 2023 @04:11AM (#36092948)
That’s typically why it’s a good idea to include a crappy “generate API” key button so you can block traffic like this, you don’t even need a registration process - someone can just email with reference to their API key to discuss their issues.
Re:[418] I'm a Teapot by usrbinbash on Saturday May 27, 2023 @04:23AM (#36092998)
> you don’t even need a registration process

You should put it behind a CAPTCHA of some sort however, otherwise, some smartass will just write a "library" auto-fetching an api key as soon as the one it has currently cached stops working.

And yes, that is an annoyance to users, but so what? Please direct all complaints to the comparatively small number of people responsible for the fact that the rest of us cannot have nice things.

Re:[418] I'm a Teapot by Etheryte on Saturday May 27, 2023 @07:16AM (#36093768)
This is not really a problem, you can easily disable generating new keys and sidestep the problem. Everyone who's legit can keep using their old keys.
Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @09:55AM (#36094866)
CAPTCHA is for humans while this json service is for machines
Re:[418] I'm a Teapot by n0n0n4t0r on Saturday May 27, 2023 @04:48AM (#36093090)
Wikipedia had a similar situation with a single flower image being requested so many times. I can't find the story and don't remember it well, but I think it was a big indian company using this image to check if internet was available.

IMHO, one of the problems is that many dev. don't realize both the size of their company and the impact of so many requests.

I hop you'll find a solution, and thank you for your service!

PS: maybe you should create a dedicated post about this subject to attract visibility

Re:[418] I'm a Teapot by parekhnish on Saturday May 27, 2023 @04:53AM (#36093115)
Oh yes! I remember that!

[1]: Wikimedia Phabricator link: https://phabricator.wikimedia.org/T273741

[2]: HackerNews thread: https://news.ycombinator.com/item?id=26072025

Re:[418] I'm a Teapot by danpalmer on Saturday May 27, 2023 @05:51AM (#36093390)
> However Cloudflare doesn't properly ... Despite numerous support requests, that's still shmaybe an enterprise level feature.

This matches my experience. I'd use the CF free plan assuming no guarantees for a low risk site like my personal site, and I'd use the expensive enterprise plan where I'm paying individually for features and quota, but I'd never use the middle-ground "sure it's unlimited!" plan – it's far too vague about what it _actually_ provides.

Re:[418] I'm a Teapot by TallGuyShort on Saturday May 27, 2023 @08:28AM (#36094173)
Ironically, "sure it's unlimited" is now a thing the parent comment has probably learned not to say too.
Re:[418] I'm a Teapot by megablast on Saturday May 27, 2023 @07:29AM (#36093832)
> literally fucking killing me

Wow, that's crazy.

Re:[418] I'm a Teapot by netsharc on Saturday May 27, 2023 @07:34AM (#36093856)
> You're literally fucking killing me.

Literally being killed? Call the police!!!11

Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @08:44AM (#36094314)
> That kind of increase in traffic costs me money I've never had to plan for.

https://getjsonip.com/#plus

  Going further with jsonip Plus
  With the upcoming Plus service, you get special features and 
  even more information about your users.

    - All of the free service features
    - IP geo location - Country and city to within best available accuracy
    - ISP Info
    - Time zone data
    - Full referer data
    - Browser and OS info
https://web.archive.org/web/20200811215649/https://getjsonip...

A paid service has been "upcoming" since at least August 2020, which would subsidize the free tier usage you allow on your site.

If it's costing you money, shipping the Plus features might offset your out of pocket expenses.

This is a failure of growth/capacity planning and lack of a proper TOS that clarifies "unlimited within reason and at our sole discretion with no SLA or warranty of any kind for non-paying users", as well as failure to ship any monetizing features 3 years after announcing it.

Contacting them to have them stop wouldn't solve your problems. What happens when the next million devices get random updates from literally anybody that starts doing it again? Try to implement rate limiting, optimize your hot code paths, watch out for slow clients (buffered reverse proxies), needless header parsing, slow template rendering, etc. Any language capable of concurrency should be able to handle 100s of thousands of requests on a cheap vm. The client ip is coming to you in the request headers and all you do is print it back to them... A go handler would be a few lines of code to do this and that's including dealing with reverse proxy real-ip type stuff. You don't need to allocate an actual struct and serialize into a json object, just printf a hardcoded string with a replacement for the ip from the header, or better yet benchmark the fastest solution.

I'll do it for you, I'm looking for a job ;)

Re:[418] I'm a Teapot by manfre on Saturday May 27, 2023 @09:36AM (#36094720)
You assumed the issue relates only to compute costs. Even with a small payload, bandwidth fees can add up quickly when millions of clients are polling.
Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @09:43AM (#36094779)
Building the paid features announced 3 years ago would pay for compute as well as bandwidth. If the service runs at a loss after that, shut it down or start reaching out to these companies that have integrated it into their products and ask them to sponsor the service, which will certainly be cheaper for the company compared to the cost of dev time to change to some other service that can shutdown just as quick, QA the updates, iterate, approve, ship, wait for adoption, triage bugs, manage all the people doing those things, etc.

Or better yet update the TOS to be free and unlimited for non-commercial use, and to contact sales for commercial use with an estimate of request volume, then sign a phat enterprise contract and rest easy

Re:[418] I'm a Teapot by geuis on Monday May 29, 2023 @03:47AM (#36111702)
This. It's mainly bandwidth costs that are the issue. Dealing with cpu is easy and cheap. Bandwidth is the mind killer.
Re:[418] I'm a Teapot by timbuchwaldt on Saturday May 27, 2023 @08:49AM (#36094364)
We see your exact Dalvik problem on deepl.com as well. We get a constant flood of those requests, sometimes subsiding. They are globally distributed, preliminary in lower-income countries. We have tried lots of things, like letting them just time out, returning different errors, redirecting of many sorts including Android intents, no solution. They now made it to our permanent blocklist and we just deal with the useless additional traffic. We are still hyper curious what on earth is loading us and for what reason though. AFAIK we couldn't see translation requests from them, just loading our website.
Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @09:37AM (#36094723)
Welcome to the internet. Install pfsense/opnsense and run your own firewall at home and you'll be shocked at the flood of non-stop portscans hitting your ip getting blocked. This is par for the course and there is nothing you can do to prevent it, you have to build systems able to mitigate, offload, block bad actors. This will always be the case.

Any free service that has utility will be quickly scripted against and used to make someone else money. Build accordingly

Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @11:06AM (#36095400)
You mentioned low income countries. This could be infected devices running ancient unpatched OSes, but what if the traffic is legit, coming from impoverished countries who found your service and use it to teach their children and learn things they'd otherwise not have access to?

Personally I would deep dive the traffic and try to determine the intent behind it, you could be destroying a future generation's potential, and not blocking malware I'm assuming you can correlate the requests from those ips with that they are translating. Odds are someone is hitting your service to translate for their paid service, but if it's an important part of a poor country, I'd find a way to allow it to keep happening

> AFAIK we couldn't see translation requests from them, just loading our website.

Browser homepage? Or maybe the unlucky victim of a "connectivity check/am I online" recurring task

Re:[418] I'm a Teapot by geuis on Saturday May 27, 2023 @02:47PM (#36097164)
That's interesting. The traffic sources hitting me seem to be the opposite. Mainly US, Western Europe, and other better well to do places around the world. I suspect a lot of the traffic is from apps on smart devices. I've seen user agents that reference Bravia tvs for example.
Re:[418] I'm a Teapot by christiangenco on Saturday May 27, 2023 @09:15AM (#36094560)
Sounds like you’ve built a valuable service that large companies are using in production! Why not start charging for it?
Re:[418] I'm a Teapot by geuis on Monday May 29, 2023 @03:55AM (#36111756)
Have been thinking about it for a couple years. People generally don't realize the complexity that gets added when you start charging money for something.
Re:[418] I'm a Teapot by RobotToaster on Saturday May 27, 2023 @10:28AM (#36095091)
I hate to add to your headache, but multiple pihole ad blacklists contain your domain. It looks like https://winhelp2002.mvps.org/ may be the original source of the blacklisting.
Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @10:36AM (#36095167)
pihole and other dns blocklists would reduce traffic to their service, not increase it
Re:[418] I'm a Teapot by nickjj on Monday May 29, 2023 @06:28PM (#36118846)
Yeah but it means their service is less valuable. If adblockers block traffic to that domain then there's less incentive to pay for the service because an undetermined but ever growing percentage of traffic will block it.

Now it's a headache for a different reason.

Re:[418] I'm a Teapot by News-Dog on Saturday May 27, 2023 @09:58PM (#36100408)
hosts file (modified) sourced from; Steven-Black - hosts @GitHub : https://github.com/StevenBlack/hosts

cat /etc/hosts |grep -i 'jsonip.com'

  0.0.0.0 jsonip.com
  0.0.0.0 www.jsonip.com
Re:[418] I'm a Teapot by jgrahamc on Saturday May 27, 2023 @10:46AM (#36095235)
I’d love to know more about

“However Cloudflare doesn't properly route ipv4 address because "ipv6 is cool so we only do that" or something. Despite numerous support requests, that's still shmaybe an enterprise level feature.”

[email protected] if you can share your interactions with us.

Re:[418] I'm a Teapot by ransackdev on Saturday May 27, 2023 @11:22AM (#36095520)
Couple things to consider

1. Check your competitors who return json and see if they have a Location header 301'ing or 302'ing all their traffic to your service (if the client follows redirects).

2. Reverse dns lookup your origin ips and see if anyone has a domain's dns pointed at your service. Check the Host header on your end and make sure it's your domain as well as ensure your web server and/or proxy are not blindly accepting traffic for `*`/any host, and make sure it's serving only your host

3. Ip address headers can be spoofed. It might not be coming from where you think it's coming from