News for hackers. Stuff that matters.
Re:98% of sites on Cloudflare now use IPv6 by dx034 on Monday November 21, 2016 @10:16AM (#13005958)
Interesting that Google doesn't seem to use ipv6 for their crawlers. They seemed to be big supporters for ipv6, but they don't appear anywhere on the list. I'd expect them to cause much more traffic than Facebook.

Any clue why they only crawl via ipv4?

Re:98% of sites on Cloudflare now use IPv6 by zerognowl on Monday November 21, 2016 @11:48AM (#13006782)
Because their crawler is so monolithic that it would be expensive and annoying overhauling it for IPV6.

There is a great use-case for IPV6 for IOT where each device gets its own IPV6 address. IPV6 addresses are appearing more like MAC addresses at this rate as IPV6 is not exhausted yet.

Re:98% of sites on Cloudflare now use IPv6 by drcross on Monday November 21, 2016 @12:51PM (#13007344)
>is not exhausted yet.

The world will be a completely unrecognizable place when this is even a slight concern.

Re:98% of sites on Cloudflare now use IPv6 by SteveNuts on Monday November 21, 2016 @01:01PM (#13007436)
That's what they said about IPv4!

But seriously, there's an astronomical # of addresses in IPv6. You're probably right that if we ever exhaust that space, we'll probably be communicating between planets by then.

Re:98% of sites on Cloudflare now use IPv6 by zokier on Monday November 21, 2016 @02:01PM (#13008102)
There is an astronomical number of individual IPv6 addresses, but in most cases that is not really the meaningful number to look at, at least right now. IPv6 is not really supposed to be subnetted beyond /64, so that already slashes the network space quite significantly. ISPs are supposed to hand out full /48s to customers (probably does not apply to consumers though), so there goes another 16 bits. The basic unit that RIRs give to ISPs is a /32 (afaik). Which leaves far less astronomical number of individual networks left. 2^32 - 2^48 is no doubt still a pretty big number, but not really as mindbogglingly humongous as 2^128.
Re:98% of sites on Cloudflare now use IPv6 by baq on Monday November 21, 2016 @01:24PM (#13007708)
> That's what they said about IPv4!

And they were right!

Re:98% of sites on Cloudflare now use IPv6 by tombrossman on Monday November 21, 2016 @01:48PM (#13007966)
> There is a great use-case for IPV6 for IOT where each device gets its own IPV6 address.

Do you really want your IOT devices to be directly addressable on the internet? It's my understanding that having devices behind a router is safer. I go a step further and disable UPnP on my routers and everything still 'just works' including network printing.

Re:98% of sites on Cloudflare now use IPv6 by takeda on Monday November 21, 2016 @02:28PM (#13008347)
NAT is not a security feature, it wasn't meant and it doesn't by itself add anything, except complicates communication.

You supposed to control access with firewall, and controlling security is much easier when computer/device has a routable address.

Though, IoT devices should probably be restricted of any Internet access based on their security track record (but again, this is orthogonal to being directly addressable).

Re:98% of sites on Cloudflare now use IPv6 by dx034 on Tuesday November 22, 2016 @03:11AM (#13012518)
While NAT does not provide perfect security, it is a component of security in networks where most people have no idea how to harden their systems or devices. It somehow gives me comfort to know that no one can just scan the net to find my phone, as I'm not sure if it would be vulnerable.

I still don't see a reason for the average consumer to have a static, reachable IP for their devices. I see privacy concerns but no advantages.

Re:98% of sites on Cloudflare now use IPv6 by growse on Monday November 21, 2016 @01:55PM (#13008040)
Why does 'directly addressable' mean 'not behind a router'? Unless you've got a weird ISP that's delivering you Ethernet, you're going to need a router.
Re:98% of sites on Cloudflare now use IPv6 by tombrossman on Monday November 21, 2016 @02:24PM (#13008312)
That's a good point and I don't know the answer.

I have a gigabit fiber (to the home) connection which terminates at a device with 4 Ethernet jacks. They all work, I've tested connecting directly to them with a laptop, but I plug a router into it and all devices connect through that router instead. It's the 'stateful firewall' aspect of using a router that I want for improved security. https://en.wikipedia.org/wiki/Stateful_firewall

Re:98% of sites on Cloudflare now use IPv6 by belovedeagle on Tuesday November 22, 2016 @03:06AM (#13012479)
My ISP delivers me Ethernet... I doubt it's that uncommon in midrise/highrise buildings. But they will only route to a single IP address (incl for 64-bit) so then again I still need a router.
Re:98% of sites on Cloudflare now use IPv6 by p1mrx on Monday November 21, 2016 @06:15PM (#13010192)
The crawler supports IPv6-only servers, but IPv4 is preferred. For example:

https://www.google.com/search?q=site:ipv6.whatismyv6.com

"You are connecting with an IPv6 Address of: 2001:4860:4801:6::1f."

Re:98% of sites on Cloudflare now use IPv6 by dx034 on Tuesday November 22, 2016 @03:13AM (#13012530)
But why do they do that? That's what I don't understand. Google was one of the companies advertising ipv6 as the future, why don't they use it for their crawler?
Re:98% of sites on Cloudflare now use IPv6 by johansch on Monday November 21, 2016 @10:44AM (#13006191)
Because web sites won't be moving to ipv6 (only) any time soon, and the limiting factor here is residential connections, not Google?

Are you proposing that Google should crawl ipv6-only web sites? And then serve those results to whom, exactly? (I don't think there is any reliable way of knowing whether an HTTP client that's connecting to you via ipv4 is also capable of ipv6?)

Re:98% of sites on Cloudflare now use IPv6 by dx034 on Monday November 21, 2016 @11:37AM (#13006685)
Facebook seems to crawl ipv6 websites using an ipv6 connection. The Google crawler doesn't show up so it's probably working ipv4 only.

I'm just wondering why Google doesn't seem to use ipv6 where available.

Re:98% of sites on Cloudflare now use IPv6 by johansch on Monday November 21, 2016 @11:44AM (#13006745)
You mean they should prioritize ipv6 over ipv4 if a DNS lookup returns records of both? Why?
Re:98% of sites on Cloudflare now use IPv6 by zokier on Monday November 21, 2016 @12:01PM (#13006904)
That is what RFC6724 recommends as the default:

> Another effect of the default policy table is to prefer communication using IPv6 addresses to communication using IPv4 addresses, if matching source addresses are available.

https://tools.ietf.org/html/rfc6724#section-2.1

Re:98% of sites on Cloudflare now use IPv6 by TorKlingberg on Monday November 21, 2016 @11:47AM (#13006772)
Many operating systems now prioritize IPv6 over IPv4. Otherwise there wouldn't be much IPv6 traffic at all.
Re:98% of sites on Cloudflare now use IPv6 by johansch on Monday November 21, 2016 @12:05PM (#13006937)
If only v6 is available there is no point for them to include the site in their general index.

If both v4 and v6 access is available, what is the extra value of doing the indexing using v6 rather than v4? (The indexing process itself would add very little to the global usage of v6, comparatively speaking.)

Re:98% of sites on Cloudflare now use IPv6 by dx034 on Tuesday November 22, 2016 @03:16AM (#13012542)
In that case, what is the extra value of having ipv6 at all?

And Facebook seems to prefer ipv6, I guess there's a reason for that.

Re:98% of sites on Cloudflare now use IPv6 by johansch on Tuesday November 22, 2016 @05:14PM (#13018159)
Facebook engineers also declared Mark Zuckerberg dead the other week. Maybe there's no deeper lesson here?

http://www.theregister.co.uk/2016/11/11/facebook_zuckerberg_...

Re:98% of sites on Cloudflare now use IPv6 by dx034 on Tuesday November 22, 2016 @03:15AM (#13012538)
Because otherwise we don't need ipv6. Google advertised the use of ipv6 heavily. If everything still works fine with ipv4 and NATs, why should we ever switch? It's a serious question, I know that the ipv4 space is somehow exhausted, but I can still get very cheap ip addresses (one is included in every $5 vps at major providers).

If even Google with its huge network of crawlers doesn't see the need to communicate via ipv6, why should there be any demand?

Re:98% of sites on Cloudflare now use IPv6 by Nullabillity on Monday November 21, 2016 @11:52AM (#13006814)
> I don't think there is any reliable way of knowing whether an HTTP client that's connecting to you via ipv4 is also capable of ipv6?

Send XHRs to a v4 subdomain and a v6 subdomain, check which requests succeed.

Re:98% of sites on Cloudflare now use IPv6 by johansch on Monday November 21, 2016 @12:08PM (#13006958)
Sure, messy, but would generally work.

I guess they could also move this checking to the user agent (because they control Chrome) to have the check performed before the user is actually waiting for results and milliseconds matter. Introduce some ugly but pragmatic HTTP header, like "Accept-IP: v6". :)

So, this way they could serve v6-only results reliably to clients that can access either both v4 and v6. (People who can only access v6.. that must be a very special kind of people.)

Re:98% of sites on Cloudflare now use IPv6 by PudgePacket on Monday November 21, 2016 @10:28AM (#13006047)
Does google use cloudflare? If not then their data probably wouldn't show up.
Re:98% of sites on Cloudflare now use IPv6 by dx034 on Monday November 21, 2016 @11:36AM (#13006676)
Not directly, but their crawler will use Cloudflare. same as with Facebook. They don't use Cloudflare but crawl websites that use it.
Re:98% of sites on Cloudflare now use IPv6 by driusan on Monday November 21, 2016 @10:30AM (#13006064)
They're in the chart. They're hovering near the bottom around 0%.
Re:98% of sites on Cloudflare now use IPv6 by brianwawok on Monday November 21, 2016 @10:49AM (#13006242)
Google is a partner of cloudflare. They have their own CDN though.