News for hackers. Stuff that matters.
Re:AT&T Fiber in the SF Bay Area is flipping bits by Nextgrid on Monday December 07, 2020 @08:42PM (#25340546)
The problem is that the idiots the hire to do their "technical" support have zero skill (nor motivation to learn) to assess whether it's a 5% problem or not, and the majority of end-users aren't capable to answer that question either, nor that they are incentivized to answer truthfully.

The solution could be a priority support tier where you pay upfront for an hour of a real network engineer's time (decently compensated so that he actually cares about solving the problem) and the charge is refunded only if the problem indeed ends up being on the ISP's side. This should self-regulate as anyone wasting the engineers' time for a simple problem they could resolve themselves would pay for that time.

Re:AT&T Fiber in the SF Bay Area is flipping bits by imajoredinecon on Monday December 07, 2020 @09:07PM (#25340757)
I realize this was written from a position of frustration (which I share) at getting run around by customer support, but I'd reconsider the blanket characterization of tech support staff as "idiots": they're doing a high-throughput job following a playbook they're given with, as you identify, no incentive---it's probably less about personal motivation than the expectations that are set for how they perform their job---to break rules to provide better customer service to people with 5% problems.
Re:AT&T Fiber in the SF Bay Area is flipping bits by dilyevsky on Monday December 07, 2020 @09:22PM (#25340873)
+1 the real idiots here are att mid-upper management that setup this process and also have zero monitoring for packet loss/bit flips apparently so that they have an outage for weeks now. Support techs have no training nor tooling to debug this issue.
Re:AT&T Fiber in the SF Bay Area is flipping bits by matthias509 on Monday December 07, 2020 @10:45PM (#25341522)
I cope with level 1 support by remembering we have a common goal: to stop talking to each other as quickly as possible. The tech just wants to close the case and I want to talk to someone else who can actually help me.
Re:AT&T Fiber in the SF Bay Area is flipping bits by User23 on Monday December 07, 2020 @11:04PM (#25341629)
That’s a great example of finding how you’re aligned and then using it to get a mutually beneficial outcome.
Re:AT&T Fiber in the SF Bay Area is flipping bits by cpach on Monday December 07, 2020 @09:18PM (#25340836)
Good point. The managers would probably give negative feedback to people that took more time on their calls in order to try to help the customer better.
Re:AT&T Fiber in the SF Bay Area is flipping bits by GauntletWizard on Monday December 07, 2020 @08:56PM (#25340676)
Who decides if it's the ISP's problem? What if it's "Both"?

About 20 years ago I got escalated to high-tier Comcast support for an issue that turned out to be a little of A, a little of B: Comcast (Might have been @Home, based on the timing) required that your MAC address be whitelisted as part of their onboarding process. Early home routers had a "MAC Address Clone" feature for precisely this reason. At some point, the leased network card got returned to Comcast. Our router continued to work just fine... until about a year later, when the local office put that network card into some other customer's home. We started getting random disconnects in the middle of the day, and it took forever to diagnose, as the other customer was not particularly active with their internet use. Whose fault was it? Ours, for ARP Spoofing? Theirs, for requiring the spoofing?

Re:AT&T Fiber in the SF Bay Area is flipping bits by saagarjha on Monday December 07, 2020 @09:54PM (#25341112)
How did you even manage to figure this out? I’ve never gotten anyone on the phone who could possibly help in a situation like this.
Re:AT&T Fiber in the SF Bay Area is flipping bits by GauntletWizard on Tuesday December 08, 2020 @12:14AM (#25342143)
Wireshark and escalation to a competent tech. I believe they saw weird traffic from their DHCP server, and we were able to attach an ethernet hub (Not switch, a 10-Base-T Hub that repeated the signal on each port) along with a laptop that was running Ethereal (Before the name changed! How long ago that was now) and see the arp packets fighting.
Re:AT&T Fiber in the SF Bay Area is flipping bits by jlgaddis on Tuesday December 08, 2020 @01:40AM (#25342564)
> I believe they saw weird traffic from their DHCP server, ...

That makes sense.

When the cable modem issued a DHCP request, the CMTS would have been configured to insert some additional information (a "circuit-id") into the DHCP request as it relayed it to the DHCP server.

The short version is that the "competent tech" looked at the logs from the DHCP server, which would have showed that the "same" cable modem (i.e., MAC address) was physically connected to either 1) two different CMTS boxes or 2) two different interfaces of the same CMTS.

How would one cable modem be physically present in two different locations at the same time? Obviously, it wouldn't.

At that point, either 1) there are two cable modems with the same burned in address or 2) one of the two cable modems is cloning/spoofing its MAC address. Which one of those is more likely?

(If you're interested in the details, try "DHCP Option 82" as your search term.)

Re:AT&T Fiber in the SF Bay Area is flipping bits by sagarm on Monday December 07, 2020 @09:36PM (#25340985)
To be fair, the vast majority of technical support calls likely require only customer service rather than technical skills. Anyone with technical chops probably wouldn't last long in that environment.
Re:AT&T Fiber in the SF Bay Area is flipping bits by myself248 on Tuesday December 08, 2020 @02:15AM (#25342740)
A friend of mine used to work tech support, and said that from her perspective, a lot of the effort was trying to counter-outsmart customers who thought they were too smart.

For instance: "This might just be a loose cable, can you unplug each end of it, and plug it back in?" invariably elicited an "I've already done that", or a brief pause followed by "okay, there, I did it, do you see it?". Lies, often.

But: "Alright, I want you to try turning the cable around for me, yeah swap it end for end. Sometimes you get a connector that just doesn't fit quite right, but it works the other way around and it's faster than sending a tech to replace it", would often get a startled "Oh! I hadn't thought of that, one moment..." and then the customer actually DOES unplug the thing, and what do you know, they click it in properly this time.

Re:AT&T Fiber in the SF Bay Area is flipping bits by wccrawford on Tuesday December 08, 2020 @09:41AM (#25345713)
I worked for a call center and there was a girl there I didn't think was good at her job.

Then one day, she tells me that she tells people to unplug the power cord, cup the end in their hand, and then plug it back in.

Suddenly, I really liked her. It's a genius move that makes them think they've done something obscure, but she really just wanted them to actually check the cable.

Re:AT&T Fiber in the SF Bay Area is flipping bits by wccrawford on Tuesday December 08, 2020 @09:44AM (#25345765)
I worked for a computer support once, and just as I was hired, they went from (IIRC) 6 weeks of training to only 2 weeks. Nobody came through that knowing any more than they started with in regards to fixing computers.

Luckily, I already knew how to fix them. I found the job to be a cake walk and quite liked helping people. But I had to listen to people around me fumble through it.

It was frustrating at the time, but my favorite thing that happened was that I was admonished twice for having average call times that were too low. To them, that's a warning that someone is just getting people off the line without fixing their problems.

They monitored calls and they said I'd never received a complaint, but the system would keep flagging me for low call times so I had to artificially raise them. They suggested that I have a conversation with the clients.

I didn't, and I didn't stay there much longer, but it was quite a crazy situation. But I also felt much less pressure to handle calls quickly after that, too, which was nice.

Re:AT&T Fiber in the SF Bay Area is flipping bits by thrower123 on Tuesday December 08, 2020 @09:25AM (#25345496)
A huge percentage of companies have their help desks and customer support outsourced to TCS or Cognizant or Accenture, etc.

Everything they do is driven by metrics, and their contracts are written around KPIs like maintaining a ludicrously short average time to answer, short handle times, and open/closed ticket ratios. If they do not hit these metrics, then the outsourcing company owes service credits. The incentives do not align with making customers happy and solving their problems. Everything is geared towards deflecting users with self-help options, simple scripts for the agents, and walking the line of hitting those metrics with the fewest number of warm bodies.

It's a pretty hellish business.

Re:AT&T Fiber in the SF Bay Area is flipping bits by myself248 on Tuesday December 08, 2020 @12:20PM (#25348291)
This blows my mind, because why would a customer come back when they're treated like that? Oh right, because they don't have anywhere else to go.

For the last several years, I've gotten my mobile service through an MVNO named Ting. On the rare occasion that I've needed to call support, there's no IVR, just a human who typically answers on the second ring. They speak native English, and have never failed to solve my problem either immediately or with one prompt escalation.

They're so jarringly competent I wonder how they still exist, if being obnoxiously incompetent is apparently a business requirement.