News for hackers. Stuff that matters.
Re:The Case Against ISP Tolls by throwaway2048 on Thursday April 24, 2014 @04:43PM (#7642849)
You are forgetting one central point, customers pay Comcast to receive netflix. It is their customers requesting this data, if Comcast truely has issues with the costs of this it is customers who should be paying more, not Netflix.

The truth of the matter is this has absolutely zero to do with costs, and everything to do with extracting rent via market position.

Re:The Case Against ISP Tolls by couchand on Thursday April 24, 2014 @11:36PM (#7644624)
+1 for being the first person on this thread to refer to this as rent-seeking.
Re:The Case Against ISP Tolls by exelius on Thursday April 24, 2014 @04:51PM (#7642898)
In this case, Comcast has two choices: raise prices on all their customers, or raise prices on Netflix's customers by charging Netflix for their increased usage. Prior to paying Comcast for transit, if Netflix decided to push 4k streams, that decision carried no repercussions for Netflix. Now they have to do a business case to see if the increased cost is worth it.

I know it's not a popular opinion on HN, but I don't think it's unreasonable for Comcast to ask Netflix to shoulder some of the cost. It also has the added benefit of incentivizing Comcast to provide faster service. If they can charge Netflix more for pushing more data, then it directly leads to more profit if their users consume more data.

Re:The Case Against ISP Tolls by amalcon on Thursday April 24, 2014 @05:18PM (#7643081)
> if Netflix decided to push 4k streams, that decision carried no repercussions for Netflix

This is not true. Netflix has to pay for transit of the bits leaving their servers just like everyone else. They just pay their transit provider for this, not Comcast (well, except when it is Comcast, but that's beside the point).

The right ways for Comcast to keep their costs under control re: video streaming would be to either meter pricing or drop rate limits. The problem is that metering is unpalatable to their customers, and rate limit drops would expose the lie that the entire cable modem marketing engine is based on (that last mile downstream throughput maximum is the only number that matters).

Re:The Case Against ISP Tolls by Touche on Thursday April 24, 2014 @07:49PM (#7643852)
> This is not true. Netflix has to pay for transit of the bits leaving their servers just like everyone else. They just pay their transit provider for this, not Comcast (well, except when it is Comcast, but that's beside the point).

Netflix doesn't have a transit provider any more. They are piping directly into Comcast and wanted to do so for free. I want my website to be delivered to all Comcast customers for free, do you support that?

Re:The Case Against ISP Tolls by bdb on Thursday April 24, 2014 @08:14PM (#7643959)
The alternative is for Comcast to buy enough transit to receive those bits from Netflix. I'm sure Netflix would be happy enough to deliver those bits to Comcast via transit, if enough capacity was available.

Shouldn't Comcast be required to purchase enough capacity to provide high-quality service to their residential customers? SFI between a content provider and an eyeball network should be a mutually beneficial cost reduction, but Comcast has enough market power (captive broadband subs) that they can get away with intentionally not buying enough capacity to serve their customers.

Re:The Case Against ISP Tolls by Touche on Thursday April 24, 2014 @08:30PM (#7644019)
Comcast does transit with many peers, but Netflix doesn't do business with any of them because they want to lower their own costs by cutting out the middlemen.

A peering agreement is free when both sides are accepting traffic for the others, but that's not what is happening in this case. Netflix -> Comcast is one way.

Still waiting for an answer to my previous question, should Comcast delivery my personal website to their customers for free?

Re:The Case Against ISP Tolls by dangrossman on Thursday April 24, 2014 @09:12PM (#7644152)
Netflix never attempted to directly send data one-way to Comcast for free. It paid tens of millions of dollars a year to a transit provider, Cogent, that has a peering agreement with Comcast. It only stopped paying Cogent and started paying Comcast (an estimated $25-50M/year) after Comcast refused to provide adequate connectivity between its customers and Cogent for months, despite their links being maxed out at peak hours. Netflix was becoming a casualty of a long-term contract dispute between Comcast and Cogent over peering fees. Comcast was being greedy, trying to get paid twice for the service its customers already pay it to provide.
Re:The Case Against ISP Tolls by exelius on Friday April 25, 2014 @10:28AM (#7646656)
Cogent is the bottom of the barrel transit provider. You use Cogent when you have a lot of bits to push and don't particularly care if they're going to get there (seriously, Cogent has like 25% packet loss at peak times.) Most companies use Cogent for overflow; i.e. they purchase enough transit through other providers for 80-90% of peak load, then fill out the rest with Cogent. It's not that Cogent is a terrible company or anything; they just provide an inferior product at an appropriate price point. Cogent wasn't interested in paying Comcast for better service because quality of service is not the product that Cogent provides. Their business model is to take advantage of their free peering status to sell unreliable transit at rock-bottom prices. Again; it's not evil or anything, but when you use Cogent that has to be what you expect.

But Netflix was using them for almost 100% of their traffic delivery. That's insane. There are other transit providers they could have paid more to and gotten better service, but that would have meant higher costs.

The whole irony of this situation is that I've heard rumors that Netflix is paying less per gigabit to Comcast than they paid Cogent while getting better service than they would get from a top-tier provider. If that's true, other companies will be lining up to get a similar deal because they'd just be cutting out the middlemen.

Re:The Case Against ISP Tolls by Touche on Thursday April 24, 2014 @09:56PM (#7644327)
Netflix is attempted to send one-way data right now. That's what their whole campaign is about, shifting their costs onto everyone else. They don't want to go back to paying Cogent, that was much more expensive.
Re:The Case Against ISP Tolls by megaman821 on Thursday April 24, 2014 @11:38PM (#7644628)
Where are you getting this info that Netflix didn't want to pay Cogent and Level3?

It seems like Comcast entered a shitty peering arrangement with Cogent and decided not to upgrade the interconnect links in retaliation. Netflix gets caught in the crossfire and ends up having to pay Comcast directly to avoid a few million angry customers. Is there any transit provider that Netflix could have gone with that has enough interconnects with the Comcast network? If not, Netflix is forced to pay whatever price Comcast names for their customers to receive adequate video streams.

Re:The Case Against ISP Tolls by amalcon on Thursday April 24, 2014 @09:02PM (#7644122)
Yes they do. They buy transit from (e.g.) Cogent. The reason Netflix has peering agreements with Comcast is that Comcast's peering links with those providers don't have the capacity to carry the volume of traffic its users are requesting. I suspect Netflix would be equally happy if those peering links just got fixed.

> I want my website to be delivered to all Comcast customers for free, do you support that?

Sure, if your website has a peering arrangement with Comcast. Comcast isn't required to offer one to you, though.

Re:The Case Against ISP Tolls by Touche on Thursday April 24, 2014 @09:48PM (#7644296)
If you'll read the comments of most people here they believe that Comcast should peer with Netflix for free. So why should Netflix be the only ones?
Re:The Case Against ISP Tolls by pedrocr on Thursday April 24, 2014 @10:14PM (#7644383)
Anyone that's willing to deliver content at all interchange points into the Comcast network should be able to do it for free. That's the only policy that makes sense. Once the traffic is inside Comcast's network it's their responsibility to upgrade the network to be able to deliver the service their clients are paying for.
Re:The Case Against ISP Tolls by stevejones on Thursday April 24, 2014 @09:07PM (#7644139)
Where exactly is Netflix getting all this free network equipment?
Re:The Case Against ISP Tolls by nitrogen on Thursday April 24, 2014 @05:05PM (#7642981)
Once again, it is the user who requested that data from Netflix. The user pays the ISP. The ISP is already immensely profitable. Because of these things, the ISP has no need or ethical right to demand more from the user or from Netflix for providing a service the ISP already promised and the user already purchased.
Re:The Case Against ISP Tolls by Touche on Thursday April 24, 2014 @07:50PM (#7643862)
The ISP doesn't promise to make every website / service on the internet as fast as possible. It's up to every service to make themselves fast by using CDNs. In the case of Netflix, they have become big enough where they now want to be their own CDN.
Re:The Case Against ISP Tolls by nitrogen on Friday April 25, 2014 @12:12AM (#7644736)
The ISP sells "Internet" access, so it's reasonable to expect them to meet customer demand at common Internet peering points, right up to the edge of their net profits plus a reasonable return for investors.
Re:The Case Against ISP Tolls by dec0dedab0de on Thursday April 24, 2014 @05:02PM (#7642958)
It also has the added benefit of incentivizing Comcast to provide faster service.

Actually it gives them an incentive to provide slower Internet service. This encourages content providers to pay to use the Comcast private network instead of the Internet.

Re:The Case Against ISP Tolls by nitrogen on Thursday April 24, 2014 @05:06PM (#7642995)
Right, a "fast lane" for one service is really just a "slow lane" for everybody else.
Re:The Case Against ISP Tolls by jmileham on Thursday April 24, 2014 @05:18PM (#7643085)
The decision to push 4k streams certainly would carry repercussions for Netflix both from a storage and transit standpoint, even absent paying interconnect fees to Comcast.

As a cable subscriber, I expect that when paying for N Mbps of bandwidth, I'm entitled to N Mbps of bandwidth of the content of my choosing. If Comcast's pricing model needs to change to a cost-per-gigabyte model in order to cope with the increased quantity of data customers consume, so be it. But sneaking the costs onto Netflix's tab effectively shifts Comcast's costs to all Netflix customers, allowing Comcast to artificially lower their prices relative to smaller ISPs without the market share necessary to effectively extract rent from Netflix.

Re:The Case Against ISP Tolls by maxhou on Thursday April 24, 2014 @06:09PM (#7643417)
> As a cable subscriber, I expect that when paying for N Mbps of bandwidth, I'm entitled to N Mbps of bandwidth of the content of my choosing

100% of the time ? not going to happen

So let's say I'm an ISP and I bring a fiber to your home, and gives you a gigabit ethernet port. You cannot expect all current and future customers to be able to use 1 Gbit/s at the same time. You would need a big non blocking switch with as many ports as subscribers, the technology for this does not exist once you reach a large customer base.

Now do you want me to shape your link to 0.1Mbit/s, because that's the only thing I can guarantee if all customers uses their link at the same time ? Or you'd rather have the 1Gbit/s possible bandwidth ?

Which one is better:

1) guaranteed 0.1Mbit/s for 10$, 5Mbit/s for 100$, 1Gbit/s for 4000$ 2) possible 1Gbit/s for 20$ ?

If you take the globalized approach, you cannot have business like Netflix, they destabilize the equation.

Re:The Case Against ISP Tolls by jmileham on Thursday April 24, 2014 @06:35PM (#7643530)
I'll take the non-false dichotomy, please. Having enough capacity to meet the streaming demand of your current customers during peak times is a solvable problem that doesn't require a full gigabit for everybody, all the time. The pricing model required to support this while still looking attractive to customers I'll leave to Comcast's well-funded marketing department.

In order to make that happen, of course, we'd have to live in a fanciful world where shifting last-mile delivery cost to content providers wasn't an option so the painful process of exposing this cost to customers couldn't be hidden in a rat's nest of perverse incentives that benefit the most entrenched corporations. (Ironically, and despite its protestations, Netflix's ability to pay this rent is a barrier to entry for its own future competitors.)

Re:The Case Against ISP Tolls by maxhou on Thursday April 24, 2014 @08:47PM (#7644071)
> Having enough capacity to meet the streaming demand of your current customers during peak times is a solvable problem that doesn't require a full gigabit for everybody, all the time.

With adaptive streaming technology, there is not such thing as "today streaming demand"

If whenever you raise the pipe size, it is automatically filled by an higher resolution/quality/bitrate stream, it is a never ending game.

What I mean is that, whatever the state/quality of ISP networks is or could have been, we are doomed to face that "Netflix problem". If networks were better, then Netflix would already offer 4k or dual/triple HD streams and so there would be saturation anyway.

> (Ironically, and despite its protestations, Netflix's ability to pay this rent is a barrier to entry for its own future competitors.)

Actually, moving all Netflix traffic to private pipes will free the shared ones, so a new freeloader can use them and cut Netflix prices ;)

Re:The Case Against ISP Tolls by clavalle on Thursday April 24, 2014 @06:35PM (#7643533)
When they sell me the service, they don't sell it as possibly 1 Gbit/s. They sell me 1 Gbit/s. If they can't deliver, it is time to adjust that promise when I purchase the service.
Re:The Case Against ISP Tolls by wmf on Thursday April 24, 2014 @06:18PM (#7643464)
Probably what is better (or at least fairer) is a token bucket with a low guaranteed rate and a very large burst. http://blog.felter.org/post/64832783299/apropos-of-a-recent-...
Re:The Case Against ISP Tolls by click170 on Thursday April 24, 2014 @05:17PM (#7643076)
How does this incentivize them to provide faster service?

From my point of view, if they're allowed to let their service degrade so that they can turn around and charge Netflix more money to make it go faster again, how is that an incentive to provide a faster service? To me, this is an incentive to provide slower service so that they can charge companies like Google and Netflix more money.

Edit: Funny this sentence can be turned around on you by clarifying who requested those streams.

Prior to paying Comcast for transit, if Comcast Customers asked Netflix to push 4k streams to them, that decision carried no repercussions for Comcast Customers.

Re:The Case Against ISP Tolls by exelius on Friday April 25, 2014 @10:46AM (#7646794)
Yes, but Netflix has the option to not provide those streams to Comcast customers if it's not economically viable for them. As it stands, most Comcast customers only request 4k streams because Netflix defaults to the highest bitrate. Basically, by changing a default setting, Netflix pushes bandwidth and creates a tragedy of the commons situation.
Re:The Case Against ISP Tolls by mikeash on Thursday April 24, 2014 @05:07PM (#7642999)
It incentivizes Comcast to provide faster service for those who pay. It incentivizes them to provide slower service for those who don't.

We can comfortably say that 99.9% of the services on the internet are not going to pay Comcast. The big players might, but there's an extremely long tail.

Thus, for most of the internet, Comcast encounters a conflict of interest. Its actual paying customers want higher speeds. But it has every incentive to reduce speeds for services that aren't paying for more.

I pay my ISP for access to the entire internet. If they screw with my access to a service simply because they didn't pay, that makes no sense.

If I'm paying $75/month for high-speed internet access, that means the entire internet, not just the parts they get kickbacks from.

I pay my ISP for my access, Netflix pays their ISP for their access, and we get to talk to each other. That's how this stuff works. Comcast charging Netflix is double-dipping, and is directly opposed to their supposed purpose of serving me, their customer.

(Hypothetically. I'm no longer a Comcast customer, thank goodness.)

Edit: I usually hate real-world analogies, but I think it could be instructive here. Let's take the USPS as an example of something in the real world that looks a lot like an ISP.

I can pay USPS $5.60 for a flat rate Priority Mail envelope, and they will deliver the contents anywhere in the country within 2-3 days. Doesn't matter who's getting it, and doesn't matter what's in the envelope as long as it fits.

Now, let's imagine that some company ends up receiving a lot of mail. Providing mail service is expensive, right? It takes a lot of trucks and postal workers to deliver all this mail to this one company. Surely they should be charged for what they're using, right?

Of course, this company says no. These people who are sending us mail already paid USPS. It's their job to deliver mail to its destination once they get paid to do so. Why should they get paid twice to deliver the same piece of mail?

In retaliation, to "convince" this company to pay, USPS starts slowing their mail. Those trucks and mail carriers are expensive, we need some of them elsewhere. You'll just have to wait.

And as a result, because USPS is demanding that this company pay to receive mail that I already paid to send them, my "Priority Mail" starts taking 4-5 days to arrive instead of 2-3.

I hope it's obvious that USPS is completely unreasonable in this hypothetical scenario. I see no difference between this and Comcast charging Netflix for service I'm already paying Comcast for.

Re:The Case Against ISP Tolls by Touche on Thursday April 24, 2014 @07:53PM (#7643867)
> I pay my ISP for my access, Netflix pays their ISP for their access, and we get to talk to each other. That's how this stuff works. Comcast charging Netflix is double-dipping, and is directly opposed to their supposed purpose of serving me, their customer.

Netflix doesn't pay an ISP. That's the whole point of the arrangement, it goes straight from Netflix to Comcast. There is no middleman. So their peering arrangement is the equivalent of "paying their ISP".

To say that Netflix should not have to pay for internet traffic is ludicrous. I want a piece of that. Comcast should hook up their network to my servers so that my personal website is fast for Comcast users. For free of course.

Re:The Case Against ISP Tolls by irons on Thursday April 24, 2014 @08:37PM (#7644035)
Your assertion that Netflix "doesn't pay an ISP" is at odds with their description of having previously paid Cogent to carry traffic over long distances. Now, "Netflix is itself shouldering the costs and performing the transport function for which it used to pay transit providers."

In other words, you're describing a situation in which Comcast blackmailed Netflix for access to Comcast's customers as one in which Netflix claims they "should not have to pay for internet traffic". This is detached from reality.

Re:The Case Against ISP Tolls by Touche on Thursday April 24, 2014 @09:54PM (#7644319)
How was Netflix "blackmailed"? Cogent failed to provide the service they needed so they are doing it themselves. Doing it themselves is saving them a lot of money.

Now they're attempting to shift costs onto everyone else. And they're using the public's distrust of ISPs to get the public to pay for Netflix's business expenses.

Re:The Case Against ISP Tolls by mikeash on Thursday April 24, 2014 @09:29PM (#7644223)
Netflix doesn't pay an ISP? How does their traffic get into the internet, then, by magic?
Re:The Case Against ISP Tolls by Touche on Thursday April 24, 2014 @09:55PM (#7644321)
They pay transit providers to do it. Except with Comcast, who they pay directly. And save a lot of money by doing so.
Re:The Case Against ISP Tolls by mikeash on Thursday April 24, 2014 @10:02PM (#7644345)
Previously, they paid transit providers for everything, but Comcast wouldn't allow them access to their network at sufficient speeds, so they were forced into paying Comcast directly.

In other words, we're already in the double-dipping situation I'm decrying. The "we each pay our ISPs" scenario that I described and that you quoted is now, sadly, a hypothetical.

Re:The Case Against ISP Tolls by Touche on Thursday April 24, 2014 @10:10PM (#7644374)
Comcast and Cogent disagreed on who should burden the costs. Because of this Netflix went around Cogent and are doing it themselves, and saving a lot of money by doing so.

Now they are using the biased tech media to create a campaign whereby they will lower their costs even further and shift them onto others (including you and me).

Re:The Case Against ISP Tolls by elq on Thursday April 24, 2014 @10:59PM (#7644513)
You keep saying that Netflix is saving money. Please provide a reference for this.
Re:The Case Against ISP Tolls by mikeash on Friday April 25, 2014 @11:09AM (#7646970)
Netflix went around Cogent because Cogent couldn't get Comcast to bump up their peering capacity. Comcast wouldn't bump up their peering capacity because they're a monopoly in many places and have no incentive to improve.

In a reasonable free market, none of this discussion would matter. The agreements would all shake themselves out in the marketplace. But give a company a monopoly and suddenly they're not subject to the same forces. Between Netflix, Cogent, and Comcast, only one of them is a monopoly.

Re:The Case Against ISP Tolls by naviwins on Friday April 25, 2014 @12:07AM (#7644720)
Uhm... NO!

You pay for guaranteed bandwidth within Comcast network. Not the whole internet.

Which gets back to the whole issue at hand. If Netflix wants to improve their service they need to pay for better transit. So they cut out the middleman and go directly to the source of the majority of their viewers.

This is no different than Twitch, Google, or Microsoft direct peering with Comcast. They see the value in allowing people to access their services as fast as possible, so they spend the money to do so.

This is internet 101. Netflix just wants everything for free.

Re:The Case Against ISP Tolls by mikeash on Friday April 25, 2014 @11:13AM (#7647006)
If "not the whole internet" then why does Comcast provide any bandwidth outside of their own network?

I accept that they can't guarantee bandwidth once traffic gets out of their network, but as long as both sides and everything in between has adequate bandwidth, shouldn't I be able to use it?

Re:The Case Against ISP Tolls by gergles on Thursday April 24, 2014 @05:33PM (#7643194)
This may be the most astute analogy about this I've ever seen. I'm going to steal it to explain this to people. Thank you for posting it.
Re:The Case Against ISP Tolls by simplemath on Thursday April 24, 2014 @05:51PM (#7643306)
Likewise.
Re:The Case Against ISP Tolls by mikeash on Thursday April 24, 2014 @10:03PM (#7644348)
I'm glad I didn't follow my instincts this time, then.
Re:The Case Against ISP Tolls by SilasX on Friday April 25, 2014 @06:22PM (#7649410)
No sensible ISP solution to this should take `is_netflix` as an input.

If customers are requesting more data than the last-mile pipes can handle, there are a number of fair ways to handle the overuse:

- At peak times, customers are throttled in direct, formulaic proportion to past (peak) usage

- Customers are charged more for usage at peak times

- Customers are limited to n% of the pipe at peak times

Notice how none of that singles out Netflix, just high usage in general.