News for hackers. Stuff that matters.

Ask HN: What are good ways to hide metadata from your ISP?

Even with HTTPS, my ISP can still:

A) see the domain names of sites to which I connect

B)the time at which a connection was made

C) the volume of data moving over a connection

So even if I use a VPN, my ISP can still see that I connected to https://vpn.com around the same time https://vpn.com connected to https://embarrasingNSFWsite.ru. They can also see that the data from https://embarassingNSFWsite.ru is pretty similar in size to the data I recieved from my vpn.

So, are there any tools or techniques that can eliminate these inferences, or at least reduce their accuracy?

( 50 comments | 50 points | on HN )
Re:Ask HN: What are good ways to hide metadata from your ISP? by matthewmacleod on Thursday June 15, 2017 @08:22AM (#14559698)
So even if I use a VPN, my ISP can still see that I connected to https://vpn.com around the same time https://vpn.com connected to https://embarrasingNSFWsite.ru.

Your ISP is very unlikely to have access to any traffic logging from your VPN endpoint, unless you are using the same ISP for both.

My solution to this has been to spin up a VPN server on Digital Ocean and just route all traffic through that. Bonus: native IPv6 over the VPN.

Re:Ask HN: What are good ways to hide metadata from your ISP? by ra on Thursday June 15, 2017 @08:27AM (#14559731)
That's not true - you're ISP can't see the onward connection.

VPN's like PIA do provide a layer of abstraction; you could save a small amount of money running your VPN NAT on a VPS.

Re:Ask HN: What are good ways to hide metadata from your ISP? by folli on Thursday June 15, 2017 @08:27AM (#14559728)
What's the easiest way to set up a VPN on DO? Is there an image available?
Re:Ask HN: What are good ways to hide metadata from your ISP? by tyoma on Thursday June 15, 2017 @08:38AM (#14559796)
You can use Algo [1]. It packages everything you need to create a VPN on DO droplets and many other cloud platforms.

[1] https://github.com/trailofbits/algo

Re:Ask HN: What are good ways to hide metadata from your ISP? by throwanem on Thursday June 15, 2017 @09:32AM (#14560168)
OpenVPN is a "risky server"? I'd like to see a cite for that.
Re:Ask HN: What are good ways to hide metadata from your ISP? by yuvadam on Thursday June 15, 2017 @08:59AM (#14559932)
Can highly recommend Algo, it's rock solid.
Re:Ask HN: What are good ways to hide metadata from your ISP? by matthewmacleod on Thursday June 15, 2017 @08:29AM (#14559753)
I'm not aware of one, and I keep meaning to write a blog posts about the process.

There is a document on the Digital Ocean site about how to do it, though: https://www.digitalocean.com/community/tutorials/how-to-set-...

Re:Ask HN: What are good ways to hide metadata from your ISP? by richem on Thursday June 15, 2017 @09:03AM (#14559969)
Ars Technica posted a guide on this last month: https://arstechnica.com/gadgets/2017/05/how-to-build-your-ow...
Re:Ask HN: What are good ways to hide metadata from your ISP? by iDemonix on Thursday June 15, 2017 @08:38AM (#14559790)
There's a couple of docs on the DO site itself, failing that though just find any 'OpenVPN' server guide and build it on whatever flavour of Linux they build it on using DO.
Re:Ask HN: What are good ways to hide metadata from your ISP? by ra on Thursday June 15, 2017 @08:29AM (#14559747)
Look at OpenVPN.
Re:Ask HN: What are good ways to hide metadata from your ISP? by siegecraft on Thursday June 15, 2017 @09:33AM (#14560174)
Don't you get a lot of "are you a bot?" captchas (or just outright bans) from google / cloudflare / others? Happens to me with AWS.
Re:Ask HN: What are good ways to hide metadata from your ISP? by andai on Thursday June 15, 2017 @08:39AM (#14559802)
So, now you've shifted the privacy issue from your own ISP to DO's ISP (and indeed DO)? Now two entities can see everything you're doing!
Re:Ask HN: What are good ways to hide metadata from your ISP? by matthewmacleod on Thursday June 15, 2017 @09:15AM (#14560046)
Well, you've shifted it for sure, but I still think this can improve the situation:

- It's residential ISPs that are unreasonably tracking metadata, rather than infrastructure providers.

- Even if that no longer applies, it's possible to use a VPN in a friendlier jurisdiction.

- The details of what you are doing are more obfuscated. If you're sharing a VPN, that has obvious benefits. If you use an anonymous VPN, even better.

Ultimately there will always be some data about your internet use available to a determined adversary – it's ultimately just a side-effect of wanting to send data across a network. But I'm personally more interested in opting out of the dragnet-style metadata collection that's being played with in the UK, so keeping my traffic out of sight of my ISP is a benefit.

Re:Ask HN: What are good ways to hide metadata from your ISP? by zurn on Thursday June 15, 2017 @09:25AM (#14560122)
Residential ISP's often belong to same conglomerates that own web properties, ad networks etc. So they can correlate last-mile VPN traffic with web traffic by correlating IP packet sizes/timings.
Re:Ask HN: What are good ways to hide metadata from your ISP? by matthewmacleod on Thursday June 15, 2017 @10:39AM (#14560789)
I'm not really convinced that this is the case, or that they could practically do that.
Re:Ask HN: What are good ways to hide metadata from your ISP? by zurn on Thursday June 15, 2017 @11:10AM (#14561085)
I would also guess it's not widely happening currently. But it's certainly feasille and technially easy, and may become lucrative to do if "VPN" use becomes more widespread or other motives enter the picture.
Re:Ask HN: What are good ways to hide metadata from your ISP? by lbotos on Thursday June 15, 2017 @09:06AM (#14559985)
I'm not sure if you are being facetious? Isn't the point in the current moment to obfuscate?

By virtue of TCP/IP isn't it futile to think you can achieve "true privacy" without something like TOR? (A different protocol with the obfuscation baked in?)

Someone is always going to have logs of your activity, the goal being not giving them "end to end logs" easily.

Re:Ask HN: What are good ways to hide metadata from your ISP? by iDemonix on Thursday June 15, 2017 @08:39AM (#14559804)
That isn't how VPNs work. Your ISP can see that you connected or browsed to your VPN provider, but once you establish a connection, your ISP can not see traffic that moves over the VPN. Of course they can monitor the size of your bandwidth, but they can't see where you connect or similar - that is the point of a VPN.

The logging you have to worry about is the VPN endpoint, hopefully your VPN provider does not keep logs of your activity.

Re:Ask HN: What are good ways to hide metadata from your ISP? by fosco on Thursday June 15, 2017 @09:07AM (#14559991)
The EFF has a nice brief description [0] on what can be observed and by who. Keep in mind that I believe the meta data of the timestamp of a request and when a server received it was used to put someone in jail -- I am having difficulty finding the article that the moment

The EFF also has na article on fingerprinting [1] which I believe makes using a vpn moot. if you want anonymity I believe the use of tools like Qubes and Whonix would be good place to start.

[0] https://www.eff.org/pages/tor-and-https [1] https://panopticlick.eff.org/

Re:Ask HN: What are good ways to hide metadata from your ISP? by falcolas on Thursday June 15, 2017 @09:34AM (#14560179)
A VPN is the easiest, TOR the next easiest (though with both you have to be careful of revealing yourself accidentally). The only method I haven't seen discussed so far is to create a haystack in which to hide:

- Create a program to crawl and store every link provided by some link aggregator (such as HN or Reddit, or both). wget's mirroring and link rewriting is remarkably good at this.

- Create a secondary program to do Google searches on a set of arbitrary phrases (I'm thinking "go through Wikipedia & pick random phrases) and locally store those results as well. You could (carefully) include phrases you're actually interested in.

- Browse the stored data with your internet disconnected.

Of course, this limits your browsing breadth significantly, creates a delay between knowing what you want to view and being able to securely view it, and will frequently eliminate Javascript App style websites; but it's the one way I know which will make snooping on what you are actually viewing much harder.

Re:Ask HN: What are good ways to hide metadata from your ISP? by evgen on Thursday June 15, 2017 @08:05AM (#14559575)
You are mistaken about the risks of using a VPN. Your ISP is never going to see that a connection was made from VPN endpoint X and embarassing_site.com. A VPN, preferably one that does no logging, is the solution you are looking for.
Re:Ask HN: What are good ways to hide metadata from your ISP? by filleokus on Thursday June 15, 2017 @08:07AM (#14559597)
Well... I think OP is misstaken also. But if the ISP of your VPN provider (at the endpoint) and your ISP (at home / where you connect to the VPN) is the same, I guess that the ISP theoretically could match metadata as OP suggests?
Re:Ask HN: What are good ways to hide metadata from your ISP? by evgen on Thursday June 15, 2017 @11:03AM (#14561039)
Your VPN provider could have an ingress point on same ISP and as long as egress was not on same ISP you are still fine.it basically reduces to "don't be an idiot and choose some cheap/un-audited/amateur VPN provider". If worried then use something like Streisand or other roll-your-own option and use a cloud provider unrelated to ISP.
Re:Ask HN: What are good ways to hide metadata from your ISP? by jmnicolas on Thursday June 15, 2017 @08:10AM (#14559627)
Usually you choose a VPN in another country than yours.
Re:Ask HN: What are good ways to hide metadata from your ISP? by icebraining on Thursday June 15, 2017 @09:02AM (#14559962)
That's no guarantee. Just from the top of my head: Vodafone exists in many countries. Deutsche Telekom owns T-Mobile (which itself exists in multiple countries) and a few others.

Also, they may be the ISP of the site, in which case they can see your connection to the VPN and a connection from the same VPN.

Re:Ask HN: What are good ways to hide metadata from your ISP? by gmac on Thursday June 15, 2017 @08:29AM (#14559749)
Indeed. Full instructions on a good option here: https://github.com/jawj/IKEv2-setup
Re:Ask HN: What are good ways to hide metadata from your ISP? by zurn on Thursday June 15, 2017 @11:12AM (#14561112)
The VPN's upstream ISP can, and all the web properties you visit can. There is nothing to prevent your last mile ISP and the those parties from colluding (by correlating the traffic) if they find this information valuable.
Re:Ask HN: What are good ways to hide metadata from your ISP? by dreamcompiler on Thursday June 15, 2017 @08:27AM (#14559732)
What you're describing is not a vpn. A real vpn establishes an encrypted tunnel that obscures all IP metadata except the connection to the vpn provider itself.

You may be describing a reverse proxy, which is not the same thing as a vpn but if it's set up properly it still should mask the metadata of what it connects to.

Re:Ask HN: What are good ways to hide metadata from your ISP? by isseu on Thursday June 15, 2017 @09:18AM (#14560078)
I think he is talking in case the VPN ISP is the same as yours
Re:Ask HN: What are good ways to hide metadata from your ISP? by djhworld on Thursday June 15, 2017 @09:05AM (#14559977)
I'm wondering what % of an ISPS traffic is going over VPNs.

If it's a very tiny percentage, wouldn't your average VPN user stick out like a sore thumb? I mean if say, authorities were monitoring what was going on, surely a VPN is a strong signal for "extra scrutiny"?

Re:Ask HN: What are good ways to hide metadata from your ISP? by richem on Thursday June 15, 2017 @09:08AM (#14559998)
As a % sure, it's going to be small, but I use VPNs all the time to connect to corporate networks and I know I'm not the only one who does so when working from home. So while it may be a % of total traffic, it doesn't mean there is anything nefarious going on with it.
Re:Ask HN: What are good ways to hide metadata from your ISP? by Ttlequals0 on Thursday June 15, 2017 @11:35AM (#14561357)
Shameless plug but it will allow you to create on demand OpenVPN Endpoints on AWS. However you will be shifting trust to AWS. https://github.com/ttlequals0/autovpn
Re:Ask HN: What are good ways to hide metadata from your ISP? by jmnicolas on Thursday June 15, 2017 @08:09AM (#14559620)
If you really need to be stealthy, connect to a public wifi network and do your browsing from there.

If you're really paranoid, buy a dedicated laptop (with cash, preferably in another town and leave your cellphone at home).

Re:Ask HN: What are good ways to hide metadata from your ISP? by falcolas on Thursday June 15, 2017 @09:19AM (#14560088)
Bonus points for using some form of "cantenna" to extend your laptop's wifi range so you don't have to be physically close to the actual wifi access point. Also, use a random algorithm for determining where to connect to wifi from - people are bad at creating random patterns and can actually identify their location by the "hole" in a ring of used locations (see: serial killers).

It's worth remembering; 87% of people can be uniquely identified with a zip code, gender, and their birthdate.

Operational security - remaining consistently anonymous - is hard.

Re:Ask HN: What are good ways to hide metadata from your ISP? by brad0 on Thursday June 15, 2017 @09:31AM (#14560161)
Do you have a paper or article showing the unique identification stats?
Re:Ask HN: What are good ways to hide metadata from your ISP? by falcolas on Thursday June 15, 2017 @11:25AM (#14561250)
Here's when it hit HN:

https://news.ycombinator.com/item?id=2942967

There are a number of good hits on google on the search "uniquely identify person zip code birthdate"

Re:Ask HN: What are good ways to hide metadata from your ISP? by jmnicolas on Thursday June 15, 2017 @09:54AM (#14560355)
Bruce Schneieir talks about it in it's book "Data And Goliath".
Re:Ask HN: What are good ways to hide metadata from your ISP? by reacweb on Thursday June 15, 2017 @09:26AM (#14560135)
Configure your box as an onion output node. Your own traffic will be masked by the traffic of all others. This may not be very safe legally. Can we have privacy and legal safety at the same time ?
Re:Ask HN: What are good ways to hide metadata from your ISP? by nlightcho on Thursday June 15, 2017 @08:03AM (#14559563)
I would say Tor but rumor is the US gov have ways to break it.
Re:Ask HN: What are good ways to hide metadata from your ISP? by doktrin on Thursday June 15, 2017 @08:44AM (#14559831)
I don't think that's some big secret or rumor. Tor has vulnerabilities, namely that it can effectively be de-anonymized by controlling n or n% exit nodes.
Re:Ask HN: What are good ways to hide metadata from your ISP? by ksherlock on Thursday June 15, 2017 @08:14AM (#14559654)
tor (and run a tor relay to increase the volume of data). Or pilfer your neighbor's wifi.
Re:Ask HN: What are good ways to hide metadata from your ISP? by jacquesm on Thursday June 15, 2017 @08:56AM (#14559917)
Re:Ask HN: What are good ways to hide metadata from your ISP? by mulletbum on Thursday June 15, 2017 @09:57AM (#14560376)
Reading the USA section of that article is saddening. It just sounds like Police trying to bully the citizens they are protecting. What kind of community police goes around trying to find laws to charge people with when no one is complaining.
Re:Ask HN: What are good ways to hide metadata from your ISP? by gorbachev on Thursday June 15, 2017 @08:52AM (#14559894)
Not your neighbor's. The tracks will eventually lead to you.

Public wifi like someone else mentioned earlier.

Re:Ask HN: What are good ways to hide metadata from your ISP? by jvarg on Thursday June 15, 2017 @08:06AM (#14559587)
you also get a shared ip-adress on most vpn services.
Re:Ask HN: What are good ways to hide metadata from your ISP? by unstatusthequo on Thursday June 15, 2017 @11:26AM (#14561260)
Look into DNSCrypt
Re:Ask HN: What are good ways to hide metadata from your ISP? by duxet on Thursday June 15, 2017 @08:24AM (#14559708)
DNSSEC - your isp will still have ip adresses, but won't know exact domain names
Re:Ask HN: What are good ways to hide metadata from your ISP? by dannypgh on Thursday June 15, 2017 @08:56AM (#14559923)
That's not what DNSSEC is. DNSSEC is about signing the data in DNS, not encrypting it in transit. The same metadata analysis is possible.
Re:Ask HN: What are good ways to hide metadata from your ISP? by icebraining on Thursday June 15, 2017 @09:07AM (#14559990)
Also, if they can see your DNS, chances are they can see the TLS handshake, so SNI would leak the domain anyway. But a VPN should encrypt both.
Re:Ask HN: What are good ways to hide metadata from your ISP? by duxet on Thursday June 15, 2017 @12:43PM (#14562002)
Sorry, that's right, i was talking about DNSCrypt of course.