The truth of the matter is this has absolutely zero to do with costs, and everything to do with extracting rent via market position.
I know it's not a popular opinion on HN, but I don't think it's unreasonable for Comcast to ask Netflix to shoulder some of the cost. It also has the added benefit of incentivizing Comcast to provide faster service. If they can charge Netflix more for pushing more data, then it directly leads to more profit if their users consume more data.
This is not true. Netflix has to pay for transit of the bits leaving their servers just like everyone else. They just pay their transit provider for this, not Comcast (well, except when it is Comcast, but that's beside the point).
The right ways for Comcast to keep their costs under control re: video streaming would be to either meter pricing or drop rate limits. The problem is that metering is unpalatable to their customers, and rate limit drops would expose the lie that the entire cable modem marketing engine is based on (that last mile downstream throughput maximum is the only number that matters).
Netflix doesn't have a transit provider any more. They are piping directly into Comcast and wanted to do so for free. I want my website to be delivered to all Comcast customers for free, do you support that?
Shouldn't Comcast be required to purchase enough capacity to provide high-quality service to their residential customers? SFI between a content provider and an eyeball network should be a mutually beneficial cost reduction, but Comcast has enough market power (captive broadband subs) that they can get away with intentionally not buying enough capacity to serve their customers.
A peering agreement is free when both sides are accepting traffic for the others, but that's not what is happening in this case. Netflix -> Comcast is one way.
Still waiting for an answer to my previous question, should Comcast delivery my personal website to their customers for free?
But Netflix was using them for almost 100% of their traffic delivery. That's insane. There are other transit providers they could have paid more to and gotten better service, but that would have meant higher costs.
The whole irony of this situation is that I've heard rumors that Netflix is paying less per gigabit to Comcast than they paid Cogent while getting better service than they would get from a top-tier provider. If that's true, other companies will be lining up to get a similar deal because they'd just be cutting out the middlemen.
It seems like Comcast entered a shitty peering arrangement with Cogent and decided not to upgrade the interconnect links in retaliation. Netflix gets caught in the crossfire and ends up having to pay Comcast directly to avoid a few million angry customers. Is there any transit provider that Netflix could have gone with that has enough interconnects with the Comcast network? If not, Netflix is forced to pay whatever price Comcast names for their customers to receive adequate video streams.
> I want my website to be delivered to all Comcast customers for free, do you support that?
Sure, if your website has a peering arrangement with Comcast. Comcast isn't required to offer one to you, though.
Actually it gives them an incentive to provide slower Internet service. This encourages content providers to pay to use the Comcast private network instead of the Internet.
As a cable subscriber, I expect that when paying for N Mbps of bandwidth, I'm entitled to N Mbps of bandwidth of the content of my choosing. If Comcast's pricing model needs to change to a cost-per-gigabyte model in order to cope with the increased quantity of data customers consume, so be it. But sneaking the costs onto Netflix's tab effectively shifts Comcast's costs to all Netflix customers, allowing Comcast to artificially lower their prices relative to smaller ISPs without the market share necessary to effectively extract rent from Netflix.
100% of the time ? not going to happen
So let's say I'm an ISP and I bring a fiber to your home, and gives you a gigabit ethernet port. You cannot expect all current and future customers to be able to use 1 Gbit/s at the same time. You would need a big non blocking switch with as many ports as subscribers, the technology for this does not exist once you reach a large customer base.
Now do you want me to shape your link to 0.1Mbit/s, because that's the only thing I can guarantee if all customers uses their link at the same time ? Or you'd rather have the 1Gbit/s possible bandwidth ?
Which one is better:
1) guaranteed 0.1Mbit/s for 10$, 5Mbit/s for 100$, 1Gbit/s for 4000$ 2) possible 1Gbit/s for 20$ ?
If you take the globalized approach, you cannot have business like Netflix, they destabilize the equation.
In order to make that happen, of course, we'd have to live in a fanciful world where shifting last-mile delivery cost to content providers wasn't an option so the painful process of exposing this cost to customers couldn't be hidden in a rat's nest of perverse incentives that benefit the most entrenched corporations. (Ironically, and despite its protestations, Netflix's ability to pay this rent is a barrier to entry for its own future competitors.)
With adaptive streaming technology, there is not such thing as "today streaming demand"
If whenever you raise the pipe size, it is automatically filled by an higher resolution/quality/bitrate stream, it is a never ending game.
What I mean is that, whatever the state/quality of ISP networks is or could have been, we are doomed to face that "Netflix problem". If networks were better, then Netflix would already offer 4k or dual/triple HD streams and so there would be saturation anyway.
> (Ironically, and despite its protestations, Netflix's ability to pay this rent is a barrier to entry for its own future competitors.)
Actually, moving all Netflix traffic to private pipes will free the shared ones, so a new freeloader can use them and cut Netflix prices ;)
From my point of view, if they're allowed to let their service degrade so that they can turn around and charge Netflix more money to make it go faster again, how is that an incentive to provide a faster service? To me, this is an incentive to provide slower service so that they can charge companies like Google and Netflix more money.
Edit: Funny this sentence can be turned around on you by clarifying who requested those streams.
Prior to paying Comcast for transit, if Comcast Customers asked Netflix to push 4k streams to them, that decision carried no repercussions for Comcast Customers.
We can comfortably say that 99.9% of the services on the internet are not going to pay Comcast. The big players might, but there's an extremely long tail.
Thus, for most of the internet, Comcast encounters a conflict of interest. Its actual paying customers want higher speeds. But it has every incentive to reduce speeds for services that aren't paying for more.
I pay my ISP for access to the entire internet. If they screw with my access to a service simply because they didn't pay, that makes no sense.
If I'm paying $75/month for high-speed internet access, that means the entire internet, not just the parts they get kickbacks from.
I pay my ISP for my access, Netflix pays their ISP for their access, and we get to talk to each other. That's how this stuff works. Comcast charging Netflix is double-dipping, and is directly opposed to their supposed purpose of serving me, their customer.
(Hypothetically. I'm no longer a Comcast customer, thank goodness.)
Edit: I usually hate real-world analogies, but I think it could be instructive here. Let's take the USPS as an example of something in the real world that looks a lot like an ISP.
I can pay USPS $5.60 for a flat rate Priority Mail envelope, and they will deliver the contents anywhere in the country within 2-3 days. Doesn't matter who's getting it, and doesn't matter what's in the envelope as long as it fits.
Now, let's imagine that some company ends up receiving a lot of mail. Providing mail service is expensive, right? It takes a lot of trucks and postal workers to deliver all this mail to this one company. Surely they should be charged for what they're using, right?
Of course, this company says no. These people who are sending us mail already paid USPS. It's their job to deliver mail to its destination once they get paid to do so. Why should they get paid twice to deliver the same piece of mail?
In retaliation, to "convince" this company to pay, USPS starts slowing their mail. Those trucks and mail carriers are expensive, we need some of them elsewhere. You'll just have to wait.
And as a result, because USPS is demanding that this company pay to receive mail that I already paid to send them, my "Priority Mail" starts taking 4-5 days to arrive instead of 2-3.
I hope it's obvious that USPS is completely unreasonable in this hypothetical scenario. I see no difference between this and Comcast charging Netflix for service I'm already paying Comcast for.
Netflix doesn't pay an ISP. That's the whole point of the arrangement, it goes straight from Netflix to Comcast. There is no middleman. So their peering arrangement is the equivalent of "paying their ISP".
To say that Netflix should not have to pay for internet traffic is ludicrous. I want a piece of that. Comcast should hook up their network to my servers so that my personal website is fast for Comcast users. For free of course.
In other words, you're describing a situation in which Comcast blackmailed Netflix for access to Comcast's customers as one in which Netflix claims they "should not have to pay for internet traffic". This is detached from reality.
Now they're attempting to shift costs onto everyone else. And they're using the public's distrust of ISPs to get the public to pay for Netflix's business expenses.
In other words, we're already in the double-dipping situation I'm decrying. The "we each pay our ISPs" scenario that I described and that you quoted is now, sadly, a hypothetical.
Now they are using the biased tech media to create a campaign whereby they will lower their costs even further and shift them onto others (including you and me).
In a reasonable free market, none of this discussion would matter. The agreements would all shake themselves out in the marketplace. But give a company a monopoly and suddenly they're not subject to the same forces. Between Netflix, Cogent, and Comcast, only one of them is a monopoly.
You pay for guaranteed bandwidth within Comcast network. Not the whole internet.
Which gets back to the whole issue at hand. If Netflix wants to improve their service they need to pay for better transit. So they cut out the middleman and go directly to the source of the majority of their viewers.
This is no different than Twitch, Google, or Microsoft direct peering with Comcast. They see the value in allowing people to access their services as fast as possible, so they spend the money to do so.
This is internet 101. Netflix just wants everything for free.
I accept that they can't guarantee bandwidth once traffic gets out of their network, but as long as both sides and everything in between has adequate bandwidth, shouldn't I be able to use it?
If customers are requesting more data than the last-mile pipes can handle, there are a number of fair ways to handle the overuse:
- At peak times, customers are throttled in direct, formulaic proportion to past (peak) usage
- Customers are charged more for usage at peak times
- Customers are limited to n% of the pipe at peak times
Notice how none of that singles out Netflix, just high usage in general.
Comcast's CEO is a smug bastard who doesn't think his customers want faster speeds, or cheaper internet, or higher level of service than Comcast currently provides. The CEO doesn't care that his customer satisfaction and service ranks dead last -- he things that's just dandy. Comcast's CEO thinks they were ranked the "Worst Company In America" not because they might be the least liked in general but because a few, vocal, not-representative people on the internet were mean.
I've seen nothing of this low level of service or high cost; I can get a 150mbit connection for $89/mo. It's not Google Fiber, but it's really not bad at all (especially compared to FiOS, which I have and hate with a passion). I mean yeah, their customer service is shit, but the Internet service itself is good.
If we're going to throw out some numbers, Netflix's net income was just $112M on $4.3B in revenue last year (2.6%). Comcast's net income was $6.82B on $64.66B in revenue (10.5%). Netflix's spend on content acquisition and production is increasing, which means that 2.6% is shrinking; they're already cash flow negative IIRC. Not much room to start doubling up on bandwidth fees they already pay.
Because the customers have to pay for the bits being transmitted to them over Comcast's network, but Netflix has to pay for the privilege of competing with Comcast's own video services. It isn't coincidental that this became an issue after the FCC's Open Internet Order -- which specifically forbade discrimination against competitors to a broadband provider's own video services -- was struck down. This was pretty much the prime example of what it was intended to prevent.
I understand that Comcast doesn't like this because it makes them a simple seller of bandwidth instead of a "provider of premium services", or whatever marketing mantra they're using this week. But if customers do not want their "premium services", but just want bandwidth, the solution to that is to build better premium services, not to try to get paid twice for one stream of bits.
If the usage pattern of Comcast's users is changing such that Comcast's internet offerings are no longer bringing in enough revenue to support usage, that's a problem with the offerings. They need to charge more, or charge differently.
However they change it (if indeed they need to change it, and it's not just a money grab, which seems more likely) then they need to charge based on how their users use the service, not what specifically they're using it for. If peak usage is a problem then charge more for peak usage, but there's no reason that A should pay more for the same peak usage as B just because A's peak usage involves Netflix.
Because Netflix wants a special arrangement that makes their bits deliver more quickly. Why shouldn't they have to pay for that?
To provide the service of access to the internet, Comcast must connect with other networks that the stuff on the internet is connected to. This is the business they're in. That's specifically what customers are paying for when they buy internet access: Comcast gets money from customers, that money goes to connecting Comcast to the internet, then connecting Comcast to the customers' homes. Thus internet service is delivered.
One of these networks they must connect to in order to sell internet access is Cogent's. Behind Cogent were hundreds of thousands of sites and services, including Netflix. These customers all pay for their internet connectivity. Cogent's being paid to connect these customers to the internet (Netflix's bandwidth bill was at least in tens of millions per year), Comcast is being paid to connect its customers to the internet, they both need to connect with an adequately sized pipe to meet their obligations to their respective customers. They're both paid handsomely for the service.
Comcast was being derelict in its duty to its customers by refusing to maintain a wide enough connection between its network and Cogent's network to reliably deliver access to that part of the internet. Customers are paying for that service (unlimited access to the internet at 15+mbps), but if the part of the internet they wanted to reach was Cogent's, they couldn't get anywhere near the advertised speed, and videos sometimes buffered or downgraded bitrates at prime time.
Netflix should not have had to pay to correct this, Comcast should've. The connection between Netflix and Comcast customers wasn't poor because Netflix refused to send the bits fast enough, but only because Comcast refused to accept them fast enough. That's Comcast's responsibility to address. Providing that network on their end is the business they're in. Netflix is not trying to pay for any special "fast lane" speed that other sites don't get, and its' already paid for its internet access, it's just trying to avoid going out of business as a side effect of Comcast screwing its own customers by failing to provide the service it's been paid for.
> Netflix should not have had to pay to correct this, Comcast should've. The connection between Netflix and Comcast customers wasn't poor because Netflix refused to send the bits fast enough, but only because Comcast refused to accept them fast enough.
One thing to add to that is that Cogent was happy to deliver the bits fast enough.
When you start looking at the question like this, you're abandoning any technical argument and instead move the conversation into "well, look at all this money moving near my proximity, I should be getting my beak wet." This is a pretty good warning sign someone is/has started framing the conversation on something other than the issues at hand.
Fairness in profit margins is a red herring at best. I like the idea of network neutrality, but I have a much much much stronger fundamental belief: nobody is entitled to a business model. That kind of thing shouldn't even be given the slightest bit of consideration when setting policy.
Unless the explicit purpose of a policy is to create a business model, as is the case in Intellectual Property. Creation, improvement, destroying, or diminishing of business models is a lever that is rushed to way too quickly in some nonsense idea of "fairness" for people that are too used to cooperate welfare and don't believe in anything but entrenchment of middle of the road "compromises" that just serve as regulatory entrenchment of the status quo.
As others have commented, consumers already pay for both services.
If it's infrastructure cost that you're concerned about I've read somewhere (Bloomberg?) that Netflix offered to co-locate its equipment in Comcast's data centers but the latter refused.
Routing each bit to customer houses is the difficult part.
The offer to put Netflix's servers in a Comcast data center does not help.
The fact that Comcast is eschewing the Netflix offer of free Open Connect CDN appliances (https://www.netflix.com/openconnect) tells me that this isn't an issue relating to upstream congestion, but rather with Netflix competing with Comcast's own VOD service.
As I said, generating traffic is easy. If there is no drawbacks in raising streaming bandwidth on Netflix side, they will continue to do so, 4k streaming, multiple streams per account, YouKnowWhat... all the way until all ISP subscribers will use 100% of their available bandwidth at all time.
I may pay for a XXX Mbit/s access, but I know that no ISP can sustain that XXX limit for all customers at the same time. And I certainly don't want my ISP to shape my fiber access to 10kbit/s because that's the guarantied bandwidth they can offer me.
Note that I'm in Europe, I don't have an resentful/hateful relationship with my ISP, but I can understand the US case is different because cable companies (used to) have bad business practices.
I do agree though that nowhere in the commercials it is said that you are paying for a peak rate.
I think you mean "still have bad business practices." Comcast regularly gets rated as the worst company in the country by consumers (in some cases the worst entity, public or private, beating out the IRS for that coveted position).
nearly 1/3 of the US have only a single option for broadband internet, and that company is typically a relatively unregulated company with low business costs that charges high prices. That's just a recipe for bad behavior.
But the customer is paying for that to happen. The last mile is payed for by the customer. The deal between Comcast and Netflix is designed to handle the macro level bandwidth, which is only painful when you need to cover distances.
By putting themselves wherever Comcast asks, Netflix removed all but the last mile costs. Those costs are paid for by end users.
That's what CDNs are for. Which, as the article shows, is how Netflix delivers video to subscribers of every other major ISP. Why is it they can somehow route all that traffic to customer houses but Comcast can't?
Take "last mile" literally and divide the US in a big grid of 1x1 mile squares.
If Netflix was able to dispatch its traffic up to each of these squares, there wouldn't be any problem. but there wouldn't be any Netflix either :)
That's not how a CDN works.
Look at the diagram in the article, between the fourth and fifth paragraphs. Every other ISP uses transit networks to distribute Netflix traffic (like all other traffic) to its subscribers. Netflix puts its content on CDNs that are conveniently located to make the transit networks' job easier, by making "netflix.com" endpoints closer to large populations of subscribers. Somehow all the other ISPs manage to "route traffic to customer houses" using that arrangement. Why does Comcast have to be different?
In other words it is acting like a monopolist or a shrewd business.
Comcast's argument is that they have built a network at great expense for carrying content that others make a profit from, and they want to capture at least some of that value.
Netflix's argument is that they have built a CDN to deliver that content to Comcast's doorstep, and that Comcast won't accept it.
In my mind, Netflix charges money for their service and is not entitled to a free ride. The fact remains that running an ISP is not free, and you can't scale out a network faster than the cash flows (of which, yes, profits are a part) allow. But think about this: Netflix has a 36% gross profit margin, and Comcast's cable/Internet business has an 11% gross profit margin. Netflix's cost structure is lower in large part because Comcast does a lot of the expensive work for them (i.e. last-mile network maintenance and distribution.)
Netflix drives significantly increased Internet traffic usage, and Comcast's investors should not have to accept lower profit margins so that Netflix's investors can enjoy larger margins because of investments that Comcast's investors have made.
I would have a lot more sympathy for Netflix if their margins weren't so high. It just comes off as greedy when they have a 36% gross margin.