News for hackers. Stuff that matters.
Re:40% of Google users now connect via IPv6 by mordae on Sunday July 03, 2022 @09:45AM (#31967654)
A local ISP told me that they want to get into IPv6 as soon as possible. NATs are getting costly and moving just YouTube traffic to IPv6 would actually help a lot.

The problem is with end user devices that do not use a stable DUID and when the client hits the reset button, it changes. We are probably going to work around this by responding from the closest hop and taking the MAC into account.

Re:40% of Google users now connect via IPv6 by neilalexander on Sunday July 03, 2022 @09:51AM (#31967684)
Why should an unstable DUID matter? The prefix won't change.
Re:40% of Google users now connect via IPv6 by fulafel on Sunday July 03, 2022 @10:15AM (#31967841)
What besides presenting the same DUID would cause you to get the same prefix again?
Re:40% of Google users now connect via IPv6 by Unklejoe on Sunday July 03, 2022 @10:23AM (#31967891)
Could it be based on whatever physical port you’re attached to on the ISP’s network?
Re:40% of Google users now connect via IPv6 by neilalexander on Sunday July 03, 2022 @10:22AM (#31967888)
The host portion of the address changes. The prefix doesn’t.
Re:40% of Google users now connect via IPv6 by fulafel on Monday July 04, 2022 @03:02AM (#31974270)
The prefix delegated to you does change in many consumer ISP setups, like the upthread poster reported and I've seen in many cases in well, I think repeating your assertion doesn't really advance your argument.

Are you thinking of a scenario where the ISP customers share a single prefix? This would be contrary to all the estabilished best practices and deployment guidance for IPv6 since it wouldn't let you easily subnet. And may get the ISP in trouble with your RIR since it's just extorting customers for access to v6 addresses.

Re:40% of Google users now connect via IPv6 by tinus_hn on Monday July 04, 2022 @03:54PM (#31981093)
That is intentional. Stable identifiers that get transmitted over the internet lead to unavoidable tracking.
Re:40% of Google users now connect via IPv6 by martinald on Sunday July 03, 2022 @11:23AM (#31968393)
Why are NATs getting costly? Don't quite understand.
Re:40% of Google users now connect via IPv6 by stingraycharles on Sunday July 03, 2022 @01:15PM (#31969272)
To do NAT, you need to map (external) port numbers to (internal) IP addresses. This is done using connection tracking: tracking the state of the connection and the appropriate mapping.

And connection tracking gets expensive at scale.

Re:40% of Google users now connect via IPv6 by martinald on Sunday July 03, 2022 @01:47PM (#31969521)
Yes, I understand how NAT works.

But CPU/memory is going down in cost way faster than bandwidth demand is increasing.

Regardless, its way way cheaper than buying IPv4 blocks clearly, otherwise people wouldn't be doing it.

Edit: ok, the problem isn't hardware, it's comedy license fees. https://itprice.com/juniper-price-list/cgn.html

$470k for a license to do CGNAT at 100gbit/sec. Surely these guys are opening themselves up to be replaced with some cheaper open source based software solution?

Re:40% of Google users now connect via IPv6 by klabb3 on Sunday July 03, 2022 @02:19PM (#31969783)
> $470k for a license to do CGNAT at 100gbit/sec. Surely these guys are opening themselves up to be replaced with some cheaper open source based software solution?

Good. CGNAT needs to die. Addressing is fundamental and customers deserve not just an address, but their own RANGE, especially now that it's feasible.

Re:40% of Google users now connect via IPv6 by znpy on Sunday July 03, 2022 @02:48PM (#31969993)
i'd love to be able to also ask for the reverse-dns zone to be delegated... if i've got a public subnet, it would be lovely to be able to use it properly.

a man can dream.

Re:40% of Google users now connect via IPv6 by stingraycharles on Sunday July 03, 2022 @01:55PM (#31969591)
Software-defined networking is slowly becoming more popular, but it’s always going to be more resource intensive than these enterprise-grade routers that are typically implemented using FPGA / ASICs.

Having said that, I’m often equally baffled at just how expensive modern networking hardware is, but as it’s pretty much all of these carrier grade networking solutions being this expensive, I’m assuming it’s somewhat justified.

That doesn’t take away the fact that NAT just adds an expensive layer of complexity on top of it, and I can imagine that in the long term, IPv6 is starting to become much more attractive.

Re:40% of Google users now connect via IPv6 by kazen44 on Sunday July 03, 2022 @06:13PM (#31971464)
> I’m assuming it’s somewhat justified.

in a sense, yes. People claiming software based solutions can match performance of hardware basic ASIC's are simply not thinking about the scale and speeds of modern core routers and switches.

For instance, taken from the blog of ivan pepaljnak[0] > It’s hard to imagine how fast switching ASICs have to work – a modern data center switching ASIC can forward billions of packets per second. For example, the throughput of Broadcom Tomahawk 31 is 12.8 Tbps, and it can switch 8 billion packets per second, or 8 packets every nanosecond.

Another thing which makes routing at large scales with large traffic flows expensive is the separation of the control and data plane. most modern datacenter routers can continue forwarding traffic inside the ASIC while its control plane encounters a failure. (usually for a few 100ms to a second, after that the forwarding table will become stale, and this cannot be refreshed without a control plane).

Having a redundant control plane isn't that expensive, but it becomes harder and harder to keep this failover fast enough if your forwarding plane is pushing more and more individual traffic flows.

Then there are still other items which one can add to a modern router to make it do more but also cost more. (think about accelerated IPsec encryption, MACsec at line rate or DWDM functionality).

[0]: https://blog.ipspace.net/2022/06/data-center-switching-asic-...

Re:40% of Google users now connect via IPv6 by martinald on Sunday July 03, 2022 @02:07PM (#31969687)
Probably a bit of a cartel for "enterprise grade" networking equipment, is my guess. Was similar in the late 90s/early 00s for web/database servers.
Re:40% of Google users now connect via IPv6 by noizejoy on Sunday July 03, 2022 @05:48PM (#31971312)
My (uneducated) guess would be to look at the way patents last too long. So society ends up suffering, rather than benefiting from IP protection.
Re:40% of Google users now connect via IPv6 by Nextgrid on Sunday July 03, 2022 @04:44PM (#31970852)
I’m not sure the price is justified, however the ISP market is extremely difficult/impossible to break through for startups or any company capable of building their own. It’s a self-fulfilling prophecy, the market is hard to break into (for other reasons besides networking equipment cost) so nobody who can actually do something about it is able to get in.
Re:40% of Google users now connect via IPv6 by notatoad on Sunday July 03, 2022 @07:07PM (#31971779)
the cheaper solution is IPv6. if an organization is too resistant to change to implement IPv6, they're going to find themselves subject to exorbitant licencing fees in order to keep using the technology they are stuck on.
Re:40% of Google users now connect via IPv6 by fomine3 on Monday July 04, 2022 @03:16AM (#31974337)
CGNAT also needs IP-port-user logging to support disclose request by law enforcement.
Re:40% of Google users now connect via IPv6 by londons_explore on Sunday July 03, 2022 @01:32PM (#31969386)
Not if you only allow each user 100 connections. That's 1200 bytes of ram per customer paying 100$ a month.

And you can charge them an extra $10 per month for 'pro' internet and let them have 1000 connections for 'all the family'.

Re:40% of Google users now connect via IPv6 by welterde on Sunday July 03, 2022 @01:56PM (#31969597)
That's a laughable low limit. Even the "pro" plan would be marginal for a single person without running into limits from time to time. And nevermind power users that might do something with p2p or have a couple more devices connected to the network.

But that's besides the point. Your home router can easily have millions of connections open (if they didn't skimp on the ram anyway), but if you have CGNAT boxes that do the same for tens of thousands of customers you also have to take into account that they have to move a lot of traffic. This means routing and doing NAT in software won't cut it anymore, but you need dedicated hardware coupled with very fast specialized memory to handle that traffic.

Re:40% of Google users now connect via IPv6 by londons_explore on Sunday July 03, 2022 @02:23PM (#31969819)
You can still do hardware NAT for the few thousand connections with the most packets and software NAT for everything else.

I bet across even an ISP network of a million users, 80% of the traffic at any point in time is within 10,000 connections.

Re:40% of Google users now connect via IPv6 by stingraycharles on Sunday July 03, 2022 @02:46PM (#31969978)
You do realise that almost all connections are long-lived, and burst up and down in throughput? So the 10,000 “heaviest” connections right now are not the same as in, say, 3 seconds from now ?

So you propose constantly swapping in and out connections from “hardware NAT” to “software NAT”? What heuristic will you use to decide which connections go where?

Such a heuristic will probably look a lot like QoS, which is even more (much more!) resource hungry than NAT.

At which point will the obvious conclusion be, “maybe the carriers who actually deal with these problems have a point, NAT is indeed a significant amount of complexity, and let’s be happy IPv6 starts to make actual economic sense?”

Re:40% of Google users now connect via IPv6 by stingraycharles on Sunday July 03, 2022 @01:51PM (#31969557)
How do you ensure each user is capped at 100 connections without that check incurring additional resources?
Re:40% of Google users now connect via IPv6 by londons_explore on Sunday July 03, 2022 @02:20PM (#31969787)
You have a per user counter. So instead of 1200 bytes it's 1201 bytes per user.
Re:40% of Google users now connect via IPv6 by stingraycharles on Sunday July 03, 2022 @02:30PM (#31969866)
Memory isn’t the only dimension we care about.

You’ve basically proposed an absolutely horrible solution, for both the end-user and the ISP. Something tells me you haven’t actually done any actual low level network engineering, and just brush all this off as “how hard can it be”.

Re:40% of Google users now connect via IPv6 by kazen44 on Sunday July 03, 2022 @06:15PM (#31971479)
how are you going to keep this counter? Do you identify the bytes that are processed in individual flows? Which system will keep track of this? the control plane of the router maybe? great... you just added additional complexity instead of just pushing packets through a forwarding plane.
Re:40% of Google users now connect via IPv6 by Dylan16807 on Sunday July 03, 2022 @10:31PM (#31972911)
When an unrecognized flow shows up, punt it to software. Handle the counter there, and if it overflows then you drop the packets. No need to add anything to the control plane.
Re:40% of Google users now connect via IPv6 by kazen44 on Monday July 04, 2022 @05:11PM (#31981829)
"punting it to software" from a router with seperate control and forwarding planes perspective, is forwarding it to a control plane, instead of relying on the logic programmed inside the ASIC to forward traffic.
Re:40% of Google users now connect via IPv6 by Dylan16807 on Monday July 04, 2022 @08:05PM (#31982957)
Sorry, I meant no need to add anything to the forwarding plane, or interfere with its efficiency at all.

The point is, the really fast part doesn't need to be more complex.

The part that handles new connections needs to be marginally more complicated, but not enough that it should really matter.

Re:40% of Google users now connect via IPv6 by shepherdjerred on Sunday July 03, 2022 @01:54PM (#31969587)
Please don’t give Comcast ideas
Re:40% of Google users now connect via IPv6 by kazen44 on Sunday July 03, 2022 @11:53AM (#31968621)
because maintaining state for GCNAT tables is far more complex then just forwarding packets. routers doing NAT are thus more expensive then those just doing simple forwarding.

Also, in some countries ISP's need to map the use of a specific ip address to a specific subscriber for law enforcment purposes. GCNAT is no exception to this and creates a large amount of overhead because the public IPV4 prefix space is shared between multiple customers.

Re:40% of Google users now connect via IPv6 by TedDoesntTalk on Sunday July 03, 2022 @12:32PM (#31968937)
> because maintaining state for GCNAT tables is far more complex then just forwarding packets.

But it’s a solved problem with mature solutions, decades old. Is it really financially expensive?

Re:40% of Google users now connect via IPv6 by kazen44 on Sunday July 03, 2022 @12:56PM (#31969118)
compared to rolling out IPv6? definitely, especially on the longer term.

For instance, most Core/Edge routers (my experience is mainly with juniper MX series, but i assume the model is roughly the same for other vendors), you need specific licenses or interface card's to do stateful services like NAT.

Compared to doing IPv6, which is "just forwarding packets" and doesn't require the hardware to track state in nearly the same manner.

Most serious core/edge hardware vendors also do not put IPv6 behind licenses compared to CGNAT and other NAT-like features, because packet based forwarding is the most basic functionality a router should provide.

Routers which are able to do less state, also are frequently far less expensive.

Re:40% of Google users now connect via IPv6 by kortilla on Sunday July 03, 2022 @03:05PM (#31970109)
You’re presenting a false dichotomy. The choice for an ISP today is not “v4 or v6”, it’s either “v4 or v4+v6”. A v6 only connection in the US is unusable.
Re:40% of Google users now connect via IPv6 by Nextgrid on Sunday July 03, 2022 @04:46PM (#31970869)
The v4 fallback can operate on slower equipment if needed. The majority of bandwidth-heavy services support IPv6 (and the slowness will encourage outliers to migrate).
Re:40% of Google users now connect via IPv6 by est31 on Sunday July 03, 2022 @03:26PM (#31970262)
The more traffic you can get onto ipv6 the less stress is on the v4 infrastructure. Each v6 connection is one your CGNAT doesn't have to provide an ipv4 port for.
Re:40% of Google users now connect via IPv6 by kortilla on Sunday July 03, 2022 @04:40PM (#31970810)
So what? That’s still just a scaling factor at that point and still requires you to have v4 cgnat infrastructure + ipv6.
Re:40% of Google users now connect via IPv6 by est31 on Sunday July 03, 2022 @05:53PM (#31971356)
You don't have to beef up your v4 infra as much though. Think 4 powerful v4 routers instead of 5 or something. If the traffic to the big streaming providers doesn't have to run through these routers, you can save a lot. Same goes for the ipv4 address space you have to rent/buy. The more connections are on ipv6, the less public ipv4 addresses you need to have.

So ipv6 support might be saving you costs already in a dual stack setting.

Re:40% of Google users now connect via IPv6 by kortilla on Monday July 04, 2022 @02:04PM (#31980067)
Take a step back to the wider context of a brand new ISP though. If you’re rushing to market like Starlink appears to be, you either implement just v4 and scale later or implement both v4/v6 up front.

Until there is a bunch of exclusive v6 stuff customers will be up in arms over missing, the answer of which thing to prioritize is obvious.

Re:40% of Google users now connect via IPv6 by est31 on Tuesday July 05, 2022 @01:12AM (#31984559)
Yeah I guess it's the same as with the inter satellite communication which is promised for later, but not implemented yet so that they get at least some product out to customers. I don't think dual stack is that hard to do for entirely new networks though.

Also, one of the reasons to do satellite internet is lower latency which is a bit hurt by CGNAT infrastructure.

Last, generally brand new ISPs are in the situation that they have a hard time of getting ipv4 address space. The incumbents, especially the older ones, were around when ipv4 addesses were still plenty so they usually have way less problems with ipv4 address space. Starlink only has 166k ipv4 addresses according to https://ipinfo.io/AS14593 . Compare this to AT&T which has over a hundred million for their AS 7018 https://ipinfo.io/AS7018 alone, and there are other AS numbers they have like AS20057 with 7 million ipv4s. This roughly matches the number of AT&T customers while Starlink has more than double the number of subscribers than its number of public IPs, with growth ahead.

Re:40% of Google users now connect via IPv6 by p_l on Sunday July 03, 2022 @09:24PM (#31972551)
Having your core as v6 only lets you push NAT to limited places (one of the many options for 4x6x4 NAT, including stateless options if you're willing to cut certain corners off v4).

And v6 connections help drop the pressure on NAT resources - and sites that are optimizing for mobile connections are already going to be on IPv6 where possible (due to mobile networks prioritizing v6 traffic for various reasons, including licensing - and NAT resource costs)

Re:40% of Google users now connect via IPv6 by lmm on Sunday July 03, 2022 @09:07PM (#31972461)
CGNAT is just a slightly more fiddly version of DS-Lite (and frankly at this stage your internal network is either v6 or an ad-hoc informally-specified bug-ridden implementation of half of it). You're always going to have to do messy connection tracking stuff with connections going to v4-only sites, the only question is whether you want to do it for connections to v6-enabled sites as well or not.
Re:40% of Google users now connect via IPv6 by j16sdiz on Sunday July 03, 2022 @03:33PM (#31970309)
All apps on iOS support DNS64 on ipv6 only network.
Re:40% of Google users now connect via IPv6 by kortilla on Sunday July 03, 2022 @04:38PM (#31970801)
That doesn’t help for servers that are only reachable via ipv4 (see GitHub).
Re:40% of Google users now connect via IPv6 by wmf on Sunday July 03, 2022 @06:02PM (#31971405)
NAT64+DNS64 is specifically for IPv6-only clients to access IPv4-only servers.
Re:40% of Google users now connect via IPv6 by Taywee on Sunday July 03, 2022 @01:27PM (#31969342)
A problem being solved doesn't mean the current solution is inexpensive or optimal.
Re:40% of Google users now connect via IPv6 by wongarsu on Sunday July 03, 2022 @01:05PM (#31969173)
The same could be said about IPv6. I think the point is that IPv6 scales better with traffic increases, to the point where switching from CGNAT to IPv6 becomes financially attractive.
Re:40% of Google users now connect via IPv6 by swinglock on Sunday July 03, 2022 @01:10PM (#31969214)
What do you mean, solved problem?