News for hackers. Stuff that matters.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by IntelMiner on Friday April 06, 2018 @03:55AM (#16771689)
As an ex-Comcast employee. Seeing stuff like that happen really doesn't surprise me

When Comcast first rolled out that data cap nation wide, I started prodding at it one night out of morbid curiosity

Turned out that it would silently slurp all HTTP traffic! Once you hit some arbitrary measurement (EG: 50%) it'll immediately start hijacking all HTTP websites you visit and inject a ton of Javascript to put a message over the web page forcing you to acknowledge your cap

Nmapping the server they used caused the messages to immediately disappear. As well as the server to seemingly vanish. Turned out the firewall was just blanket banning the entire IP range when it saw a portscan!

The upside being that Comcast would stop MITM'ing HTTP traffic for about 72 hours

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by walrus01 on Friday April 06, 2018 @04:07AM (#16771726)
And people wonder why https everywhere is such a necessity now. It should not be necessary to treat your last mile ISP as a hostile entity , but sadly, it often is.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by jakeogh on Friday April 06, 2018 @04:35AM (#16771818)
I canceled my decade old COX account last time that happened. Even asked nicely not to "help" by editing traffic, the runaround was fun. At the end they offered to take my ~$90/mo to ~$70; re-confirming they had no idea what I was unhappy about.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by walrus01 on Friday April 06, 2018 @04:40AM (#16771841)
A $12/hour call center customer retention worker in rural TN has no idea what you're complaining about, their job is simply to meet some retention metrics on a weekly basis.

Even if you can actually reach the people who run the ASN of your ISPs, if it something big like Cox, charter, Shaw, etc, they'll be politically unable to confirm or deny anything, and won't want to talk to you. You might get a straight answer if you are in a similarly senior position at an equivalent sized ISP that has mutual settlement free peering, such as between RCN and Charter.

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by username223 on Friday April 06, 2018 @05:59AM (#16772116)
Such are the joys of modern "customer support" -- human beings don't scale, because they need to sleep and can only talk to one other human at a time. So you hire the cheapest ones you can find, and instruct them to be minimally helpful. Even better, make them all "managers," so "can I please speak to your manager" will just take you to another minimum-wage employee.

If you want actual customer support these days, your best bet is to create a PR problem for the company via social media, because PR flacks are paid enough to matter.

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by tialaramex on Friday April 06, 2018 @10:16AM (#16773369)
A smarter, and perhaps even more profitable way to approach this problem is "OK, we want almost everything that happens to customers to be a self-serve situation" and then make your (fewer) call centre employees highly trained troubleshooters who can figure out why _this_ customer wasn't able to self-serve and get that sorted for them. The result is a better customer experience (usually everything just works, when you need to talk to a human the human is an _expert_ who helps fix your problem, not a drone working from a fixed script) and it can be much cheaper if done right.

Definitely if you think of your product/ service as "premium" this is the correct model to have.

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by ryandrake on Friday April 06, 2018 @11:02AM (#16773746)
Lots of people simply do not like self serve. I get that companies want to cut costs, which is why we got endless telephone menu trees, then support web sites with crappy search, then automated telephone agents, then chat bots, and on and on. And the public has devised all these various tactics to skip that crap. I just want to talk to a damned human being rather than spend 10x the time navigating your poorly thought out Customer Avoidance Systems! Sometimes I need a drone and sometimes I need an expert. I have yet to see an automated system that could successfully determine which tier support I needed.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by username223 on Friday April 06, 2018 @03:13PM (#16776445)
Often I prefer "self-serve," but sometimes I like to talk to a human who knows about the system that has created my problem, and can quickly fix it. That's why there are websites dedicated to showing people how to skip through phone menus and reach actual humans, even if those humans are soundboard operators paid almost nothing to make you go away.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by jakeogh on Sunday April 08, 2018 @07:22AM (#16785648)
link? I refuse to talk to computers.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by username223 on Sunday April 08, 2018 @02:39PM (#16787546)
The fact that these pages exist tells you all you need to know about the fundamental user-hostility of modern tech companies:

https://gethuman.com

https://www.wikihow.com/Talk-to-a-Human-when-Calling-a-Busin...

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by acdha on Friday April 06, 2018 @07:20AM (#16772373)
In cases without competition. I live in an area with three gigabit-capable ISPs and the difference in support quality is unbelievable, even for the Comcast and Verizon customers – just calling from a competitive neighborhood gets your call processed differently.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by walrus01 on Friday April 06, 2018 @08:12AM (#16772581)
Which city?
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by acdha on Friday April 06, 2018 @10:44AM (#16773585)
Washington DC - my neighborhood has Comcast, RCN, and Verizon. Our neighbors report better service on all three — and when you go a couple blocks south where the FIOS rollout stopped, regression to normal sets in for Comcast.

We also have municipal fiber but they’ve chosen not to make that available for residential service which is really disappointing but … politics.

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by walrus01 on Friday April 06, 2018 @11:36AM (#16774028)
So, channel bonded docsis3.0 and 3.1 on Comcast and rcn, and gpon fiber from Verizon? Or are the cable operators also doing singlemode to the house now?
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by acdha on Friday April 06, 2018 @01:13PM (#16775008)
Definitely for RCN. Comcast ads have claimed fiber but I don’t know whether that’s available or just planned since I won’t do business with Comcast.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by goldenkey on Friday April 06, 2018 @10:13AM (#16773354)
Sounds like Seattle
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by hirsin on Friday April 06, 2018 @01:04PM (#16774910)
Impressively (given the rest of the company), Comcast DNS is on twitter [1] and is fairly responsive/tech savvy and unrestrained. It feels like someone in the department got one over on management - "look, if you get in our way things break real fast. Trust we know what we're doing and you won't get calls about state.gov being blackholed".

1. https://twitter.com/ComcastDNS

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by ams6110 on Friday April 06, 2018 @08:54AM (#16772803)
At my work, we treat our own internal network as a hostile entity. Defense in depth.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by sli on Friday April 06, 2018 @11:04AM (#16773765)
Same here. Devs can't even mount thumbdrives. Which is fine for us, we don't need them, but it prevents some funny business should one of our laptops get stolen.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by reaperducer on Friday April 06, 2018 @12:32PM (#16774544)
Ditto. No flash drives except for special ones distributed by the IT department, and even then it takes a few months of reviews to get one.

But we go one further — no development on the LAN. Develop on another server at a different hosting company, and only deploy on the production host when thoroughly vetted.

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by B1FF_PSUVM on Friday April 06, 2018 @02:36PM (#16776020)
For some reason, I get this mental image of everybody in a city street dressed in hazmat gear.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by Macha on Saturday April 07, 2018 @01:13PM (#16781622)
> no development on the LAN

Does this just mean staging/shared servers are not deployed on machines inside the corporate network, or that developers can't have their dev environment locally and instead remote in to some other machine to do their work?

I've heard of the latter in a few companies and it's always the kind of thing that makes me nope out of every applying to them.

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by reaperducer on Saturday April 07, 2018 @03:08PM (#16782230)
Devs do most of their work on localhost. Changes are pushed to an independent server on an independent network in another city. Once those changes are vetted, then the work is mirrored to production.

Each dev has his own cellular connection for internet on his development box. Again, no LAN access. Corporate e-mail and cross-department file servers are on another box on each dev's desk.

The downside is massive over-usage charges for each dev's cell data (40-50 GB/month/dev over). The upside is that devs are effectively airgapped from the company, which I assume is the primary goal of all this.

Also, chat is banned. There have been efforts in the past to bring in tools like Slack, but the honchos believe that it makes the company better as a whole if we speak to each other like human beings, especially cross-department. Even if that means slowing down a project. And even if that means having to walk across campus, or occasionally driving to another part of town to another building. Phones are largely only used when off-site, or we need to talk to someone in another city.

It all sounds tremendously inefficient, but I try to think of it as being like working at IBM or Sperry in the 60's. It seems to work. The company is profitable and expanding, and has been for 40+ years.

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by Rjevski on Sunday April 08, 2018 @12:17PM (#16786787)
Oh wow - I would not want to work there ever. I understand the need for some security but this seems just over the top.
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by lumisota on Friday April 06, 2018 @05:18AM (#16771964)
Your last mile ISP is almost certainly a hostile entity, but HTTPS alone isn't going to save you [0].

[0]: www.cs.umd.edu/class/fall2017/cmsc818O/papers/tangled-mass.pdf

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by tialaramex on Friday April 06, 2018 @10:50AM (#16773632)
That paper is from 2014 and some of the circumstances described have since changed.

They've also done some things that I assume fell out of operating ICSI's Notary but don't make any real sense for this paper.

For example: For a real user what we care about is this cert the end user was presented for a site: Would that be trusted in (Internet Explorer on XP, Safari on iOS, a Python script on a Debian machine, etcetera) and would it be trusted in this smartphone.

And what they've looked at is, were the same Trust Stores baked into an Android phone as the above systems? But that's subtly different in a way that fogs the issue here. Example:

Suppose phone X trusts ISRG Root X1, XP trusts DST Root CA X 3, and a Debian system trusts Lets Encrypt Authority X3. Those are, to the naked eye, and this study, three completely different things. But in _practice_ for an end user it'd turn out any of the three work for trusting a vast number of certificates used on the web. Trusting one or another _does_ matter, but this paper isn't about why that is, and doesn't really explain what's going on here, it treats that sort of scenario as anomalous and potentially alarming without explaining.

The paper did remind me that ICSI's Notary won't work with TLS 1.3, which I have sort of known but not ever mentally addressed. The ICSI Notary works by peeking inside TLS sessions. In versions up to TLS 1.2, the server's Certificate is delivered unencrypted, just before both peers encryption switches on and their communications are unintelligible. This is used by the Notary and by lots of crappy middleboxes, but in TLS 1.3 the encryption has switched on earlier, before the certificate is sent, so the Notary can't see certificates any more.

Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by NoGravitas on Friday April 06, 2018 @09:06AM (#16772865)
I suppose the only alternatives are to use a VPN (and hope your VPN provider isn't a hostile entity), or to use TOR (not appropriate for all kinds of traffic). This is the world we've made for ourselves...
Re:Cloudflare's new DNS attracting 'gigabits per second' of ... by rconti on Friday April 06, 2018 @02:07PM (#16775693)
They still inject that message now. I hit 90% almost monthly.