We are trying to frame people who are trying to protect their privacy as "suspicious" rather than saying that we want to track them better.
You want to determine who is manually asking vs automated so you can ignore requests that aren't manually generated.
At the server or datacenter level, it's call a firewall :)
When not in a vehicle and there are no cops around, I do the New Yorker thing: I completely ignore signals and focus on traffic. The prima facie and prime directive is safety over conformance. I will not waste my life at the behest of some Christmas lights.
there's no way to solve this problem without having some sort of tracking system to determine who's a legitmate user.
and when some legitimate users really, really look like bot traffic because they circumvent whatever methods we use to determine whether traffic is coming from real people, they might sometimes get blocked along with the bots. they're going to complain about that, and the only thing we can do is listen to their complaints.
It's not a hard concept. Unless you think you're too big to care, you fix issues you cause.
There is: get the bad actors off of the Internet.
- governments (and basically everyone without a business presence in these countries) should ban interconnections with Russia, China, North Korea and Iran. No more shady Russian hacker forums, no more "bulletproof" botnet c&c hosters where every dumbass kid can buy botnet attacks, no more government-backed or -ran hacking campaigns. These four countries had their chance, we kept them online to allow their citizens free flow of information, but since all four block large parts of the Internet anyway (or don't make it available at all in the case of NK), I don't see any point in continuing making ourselves vulnerable.
- governments have to implement serious fines for makers of IoT products and software that ends up being mass-pwned, at least in cases of gross negligency, and mandate that firmware, tooling and corresponding crypto keys be open sourced after a product is no longer receiving security updates.
- governments have to mandate that providers on the Internet of all kind - ISPs, colos, mail providers, VPN services - should have abuse email contacts and act on reports in no less than 12 hours. "str0s" (servers that are 0wned) are no fun, and so are large providers who deem themselves to be so large that they don't have to give a fuck about abuse from their systems (Google, I'm looking at your Gmail service). And no one gets to claim "we're too big, we can't afford that!!!". Oh yes you can, Google. You rake in billions of dollars in profit a year, hire some customer service agents and stop externalizing the cost of abuse on everyone else.
- Discord should be outright shut down at this point. Absolutely zero moderation happening there, as long as you don't upload CSAM that can be caught by scanners Discord will not do anything proactively. Even if you're uploading TS/SCI classified material, no one gives a fuck until someone uploads the stuff to a public Telegram channel and people start digging.
Without serious, concerted effort among all nations to fight the problem at the source, it will only get worse.
And yes, I'm a bit pissed on how little accountability there is on the Internet. If you're big enough you can do whatever the fuck you want, no one will hold you accountable ever, and it's ruining everything.
> If it were coming from one IP address nobody would be bothered by it, it would be easily solved with rate-limiting rules on the firewall.
DDOS works by sending more traffic than your upstream bandwidth can carry (e.g. you have 100 Gbit link and they send 40 Tbit of UDP packets to you). Firewall won't help here. The protocol I am talking in a comment above would solve the problem by blocking this traffic close to its source.
Not by any stretch of the imagination.
My preferred solution would be domain validated identities with long lived, global reputation alongside some type of attestation. For example, if I have a GitHub account with 'example.com' as a verified domain, GitHub could attest 'example.com seems to be a real user or organization that behaves well'. It would be similar to the web of trust concept in GPG, but technology is to the point where it could actually be built in a way that makes it usable. Money that you're spending, or the way you interact in well known communities, could have the side effect of bolstering your reputation everywhere.
My most feared solution would be a similar system of attestation, but using Passkey since it would solidify the role of the current big tech companies as the arbiters of everything online. For example:
You look like a bot. How do you want to prove you're human?
Microsoft
Google
Apple
Facebook
Those companies, as Passkey providers, would, for all intents and purposes, be your 'anchor identity' online and they'd be in a good position to attest to you behaving like a normal, non nefarious participant.I think Apple would be the company that could sell that kind of change to normal users. It could be done in a way that's anonymous because all you really need is an attestation that says 'Apple certifies this user is in good standing'. Apple is very good at selling those kinds of changes as being privacy focused and I think their user base would go for it if it were framed as 'good people' (aka Apple device owners) getting a superior experience that isn't available to the 'bad people' (aka bots, bad actors, and outliers).
If it worked, Google would follow with Android. Anyone else large enough for their opinion of you to count (Microsoft, Facebook, etc.) could probably compete, but it doesn't work for startups or small, less known providers.
In my opinion, as soon as authentication moves to something like domains or digital signatures where 3rd party attestations become simple, we could see a lot of new ideas that focus on reputation and related solutions / services.
https://support.apple.com/en-us/HT213449
https://developer.apple.com/wwdc22/10077
While its build with privacy in mind, I have some deep concerns on making these current big players gatekeepers to identity on the web
The problem is the individual sites aren’t making these highly technical decisions, people are using what seems to them an innocuous security product.
Not visiting a random website places no pressure on CloudFlare to change, since there’s no way to correlate your choice with the decision to use CloudFlare.
I'm wondering how long it will be before we have memory holes considering how, apart from the internet archive, there is perpetual bitrot and silent updates.
Too bad that basically means you can't surf the internet anymore as a majority of websites use Cloudflare. One of my Firefox installations on Linux are also plagued by this. I can't use Firefox to browse the web.
CloudFlare blocks me from a part of the internet when I use anonymizing tools like Tor. I assumed they just do that to fingerprint and track you. Even the crypto thing to get a dozen or so passes after solving a riddle never worked.
So I have just moved on to websites protected by Akamai, or virtually anything but CloudFlare. It's not just a political decision btw. It's just easier to move on than to try to fight CloudFlare or to become viral on HN to get support.
It shouldn't be up to the user to adapt, but to the website.
This is just whining. I don't necessarily like it either, but you conveniently ignore all the reasons why that rain dance supplication exists in the first place. All ears if you have a better solution for DDoS attacks, malicious bot traffic, etc.
Even if you were doing any, or all of these things, you are no less a legitimate internet user than anyone else. This whole "rain dance" supplication to show you are worthy of browsing a web site has got to go. Stop visiting sites who treat their users this badly!