News for hackers. Stuff that matters.
Re:Apple confirms it uses Google cloud for some of iCloud by greensoap on Monday February 26, 2018 @11:42AM (#16466609)
The encryption technique sounds like convergent encryption.

Convergent encryption is a fairly standard way storing encrypted data that might duplicate across users. It allows for deduping of data while in an encrypted state.

https://en.wikipedia.org/wiki/Convergent_encryption

Re:Apple confirms it uses Google cloud for some of iCloud by matt_wulfeck on Monday February 26, 2018 @11:55AM (#16466752)
Doesn’t this in some way betray the encryption? For example, if multiple users had illegal.csv in their accounts, getting access to one user will allow you to prosecute any of them without decrypting their data because they will all share the same sha?
Re:Apple confirms it uses Google cloud for some of iCloud by simias on Monday February 26, 2018 @12:06PM (#16466862)
It is (as the Wikipedia article points out). It's basically equivalent to storing passwords hashed without a salt, it makes makes it obvious when a password is reused, or in this case the same file stored twice.

That means that the provider always knows if a file is shared across multiple users (even if they don't know what the file is) and given a cleartext file they can always check if somebody has it stored on the service. It's not ideal at all if you want good privacy.

SpiderOak is explicitly supposed not to do that[1] to avoid these issues, however I refuse to recommend them until they finally decide to release an open source client and 2FA support so caveat emptor.

Anyway, in this case it's irrelevant because Apple has access to the keys anyway, it's only supposed to prevent the third party (Google Cloud in this case) from having access to the files.

[1] https://spideroak.com/resources/encryption-white-paper in the "Data Deduplication" section.

Re:Apple confirms it uses Google cloud for some of iCloud by Someone1234 on Monday February 26, 2018 @12:19PM (#16466970)
It should be pointed out that this "security flaw" is the only way these cloud file storage platforms are cost effective. Since it allows the same anonymous blob stored by several dozen users to only take up one unit of space instead of one unit per user.

This is particularly space saving if a particular file type was chunked cleverly so that static parts of the file's structure were stored away from dynamic parts (Microsoft's Office XML formats for example could definitely be split this way).

Re:Apple confirms it uses Google cloud for some of iCloud by avar on Monday February 26, 2018 @01:32PM (#16467685)
I don't believe that. Apple charges $10/mo for 1TB of data. That's $120/yr. You can get 1TB drives commercially for under $50 these days, you'd need a bit more than 1 drive per user for reliability & sharding, but still. Not de-duplicating the data would clearly be profitable anyway.

Hetzner charges less than half of that for their storage solution, and that's without de-duplication[1].

Does decreasing the security of their users & not offering end-to-end encryption save them even more money? Sure, but I don't see how it couldn't be profitable without it, seeing as you can easily buy non-de-duplicated cloud storage for way less from other providers.

1. https://www.hetzner.com/storage-box?country=us

Re:Apple confirms it uses Google cloud for some of iCloud by hvidgaard on Monday February 26, 2018 @02:33PM (#16468232)
Just look at the pricing for Amazon S3. It cost 20-30$/month * TB. This makes Apples 10$ a month for 1TB looks like a fairly good deal.

Don't forget that the price includes VAT and other taxes. General infrastructure costs, including traffic. Redundancy. Backups. I don't think they're turning much of a profit, but offer it because it makes their platform more attractive.

Re:Apple confirms it uses Google cloud for some of iCloud by snuxoll on Monday February 26, 2018 @03:09PM (#16468532)
I'm sure Apple makes plenty of money from users that don't fill up their space to pay for the ones that do.

I have a 2TB family plan that I'm paying $10/mo for, a total of 135GB is used. Most of that usage is from iCloud Photo Library, and while I could use the 200GB plan I'd rather just pay the extra to have effectively unlimited space and not worry about needing to upgrade the plan, especially as I record video in 4K by default now.

I'm sure I'm not the only person who does this, $10/mo is probably nothing to the vast majority of people on HN compared to the hassle of worrying about whether we have enough storage or not.

Re:Apple confirms it uses Google cloud for some of iCloud by giobox on Monday February 26, 2018 @04:01PM (#16468930)
iOS is pretty good about nudging you to the next tier as you approach filling your current one, IIRC. When I recently had to jump from 200GB plan to 2TB it was one tap on a notification to move to next tier for my whole family, so even for those of us who can easily afford it's arguably not that sensible a strategy to jump straight to 2TB, unless one's goal is to subsidize Apple as much as you can.

HEVC/H.265 introduced in iOS 11 largely makes shooting 4K on an iOS device cost _roughly_ the same in storage terms as 1080p/H.264 did, so recording in 4K doesn't really move the storage needle here like it used to either, assuming of course you have an iPhone 7 or newer.

Re:Apple confirms it uses Google cloud for some of iCloud by cstrat on Monday February 26, 2018 @05:51PM (#16469706)
I read this comment and was confused because it is exactly what I would have written and thought I had a moment of amnesia where I forgot that I posted a response...

Same boat 100%... Family sharing, 2TB plan, have my wife and mother in the family. Combined we use less than 200GB, but I am happy to pay for more storage rather than deal with tech support calls from them two when we go over 200GB and they get error messages popping up. :P

Re:Apple confirms it uses Google cloud for some of iCloud by lostmsu on Monday February 26, 2018 @04:50PM (#16469279)
Wow, MS Office 365 costs like $100/y for 5 users, each getting 1TB of OneDrive. And also, well, Office.
Re:Apple confirms it uses Google cloud for some of iCloud by tekknik on Tuesday February 27, 2018 @10:16AM (#16474027)
Apple includes their own office suite for free with all macs so if you don’t need 100% office compatibility why give MS more money? I haven’t had or used office in some years now and don’t miss it a bit.
Re:Apple confirms it uses Google cloud for some of iCloud by snuxoll on Monday February 26, 2018 @05:39PM (#16469646)
OneDrive also doesn't integrate well with my Apple devices, so there's that.

I do also pay for Office 365 though, $100/yr is significantly cheaper than purchasing Office for every computer in my house.

Re:Apple confirms it uses Google cloud for some of iCloud by wingworks on Monday February 26, 2018 @03:24PM (#16468656)
Apple probably pays less than $20-30/m per TB though, what with being kinda a large customer.
Re:Apple confirms it uses Google cloud for some of iCloud by hvidgaard on Tuesday February 27, 2018 @02:18AM (#16471652)
Absolutely. I was just pointing out that the price is in the better end of the scale, especially to end consumers only buying a relatively small amount of storage.
Re:Apple confirms it uses Google cloud for some of iCloud by kuschku on Monday February 26, 2018 @03:28PM (#16468691)
Hetzner, OVH, Online.net offer between 8$ and 10$/month per terabyte, duplicated and backed up, with availability guarantee.

Apple’s $10 is absolutely not a good deal.

Re:Apple confirms it uses Google cloud for some of iCloud by vesrah on Monday February 26, 2018 @04:57PM (#16469332)
It is from the standpoint of the average user that doesn't want to hassle with figuring out what backup provider to use, figure out what software they need to install, or wants to share the data automatically between multiple devices natively.
Re:Apple confirms it uses Google cloud for some of iCloud by kuschku on Monday February 26, 2018 @05:22PM (#16469520)
As the most popular comment here said when Dropbox was announced, "1. For a Linux user, you can already build such a system yourself quite trivially by getting an FTP account, mounting it locally with curlftpfs, and then using SVN or CVS on the mounted filesystem. From Windows or Mac, this FTP account could be accessed through built-in software."

Personally, I'm using seafile on a server, it's cheaper than iCloud or Dropbox, with more storage, and more custom functionality. Many NAS nowadays support Nextcloud out of the box.

Re:Apple confirms it uses Google cloud for some of iCloud by rmrfrmrf on Monday February 26, 2018 @07:56PM (#16470312)
I worked out the math a while ago and it will take over 10 years for a home-built NAS to be more cost-effective than iCloud, and that's only if there are no hardware or disk failures, and doesn't include the additional hassle of being out of Apple's model when it comes to auto-backups and storage.
Re:Apple confirms it uses Google cloud for some of iCloud by kelnos on Tuesday February 27, 2018 @03:29AM (#16471915)
It depends on what you value. If you value keeping your data at home, and accept the trade off of higher cost and the need to maintain it yourself and use some sort of sync mechanism that isn't built into the OS, then you do that.
Re:Apple confirms it uses Google cloud for some of iCloud by vesrah on Monday February 26, 2018 @05:28PM (#16469562)
Yes, you are obviously not their target market. Most people don't know what a NAS is, or what FTP is. With iCloud they toggle a switch and it Happens Like Magic.
Re:Apple confirms it uses Google cloud for some of iCloud by kuschku on Monday February 26, 2018 @05:33PM (#16469594)
The average person can figure out a car, can figure out how to vote in complicated voting systems, and can figure out much more.

You don’t have to dumb down things unnecessarily. If a person can buy a smart home device, plug it in and configure it, or an Apple TV, or a computer, then they can also get one of the simpler NAS, and sync with that.

Re:Apple confirms it uses Google cloud for some of iCloud by arbie on Monday February 26, 2018 @10:15PM (#16470837)
Except your backup is now on-site, has no redundancy and has poor accessibility outside the home network.

Geographical redundancy and low-latency data transport are nontrivial factors in pricing cloud storage.

Re:Apple confirms it uses Google cloud for some of iCloud by CamperBob2 on Tuesday February 27, 2018 @04:40AM (#16472198)
It was a naive and ridiculous comment then, and it's neither more informed nor less ridiculous now.

(Which is kind of a shame because a truly bulletproof, user-friendly NAS might be an interesting product. Who is going to be the Apple to Synology's Microsoft?)

Re:Apple confirms it uses Google cloud for some of iCloud by hvidgaard on Tuesday February 27, 2018 @02:17AM (#16471644)
So if you go somewhere else, you can get a worse experience that is not build into the OS, and save 2$/TB.
Re:Apple confirms it uses Google cloud for some of iCloud by kelnos on Tuesday February 27, 2018 @03:27AM (#16471904)
It's only a worse experience if you don't value the lack of de-duplication and the increase in privacy that gives you. Which is fine either way.
Re:Apple confirms it uses Google cloud for some of iCloud by tekknik on Tuesday February 27, 2018 @10:17AM (#16474041)
So same price and doesn’t integrate with Apple devices?
Re:Apple confirms it uses Google cloud for some of iCloud by SystemOut on Monday February 26, 2018 @02:58PM (#16468420)
Keep in mind that most people don't actually store the full 1TB of data.
Re:Apple confirms it uses Google cloud for some of iCloud by philipodonnell on Monday February 26, 2018 @02:55PM (#16468398)
I find this hard to believe. I get that it reduces space used _in thoery_, but do you have any data on the % of uploads that are duplicated across clients?

It would have to be very, very large to justify the claim that it turns a previously non-cost-effective service into a cost-effective one, especially as prices have been dropping for some time and would hypothetically have simply not dropped as fast if this was the case.

Re:Apple confirms it uses Google cloud for some of iCloud by jmulho on Monday February 26, 2018 @06:12PM (#16469854)
Pretty much everybody keeps a copy of "Bringing Sexy Back" on iCloud.
Re:Apple confirms it uses Google cloud for some of iCloud by kolpa on Monday February 26, 2018 @01:23PM (#16467612)
It's not the "only" way. Another way:

* Offer to charge less usage if a duplicate block is detected, but allow users to pay full price for privately-salted storage. This is similar in principle to how Data Saver works on your mobile device (opt-in to allow a man-in-the-middle to compress or downsample your data)

Re:Apple confirms it uses Google cloud for some of iCloud by avar on Monday February 26, 2018 @01:39PM (#16467759)
I thought they same reading this thread, but there's two huge problems with that:

a) Once you know the chunk size, you can determine based on pricing whether another customer has that data, which can have huge privacy implications.

E.g. let's say we both work at the same company and get the same salary statement PDF aside from the dollar number & your name (which I know).

I can simply brute-force craft a file that changes that number around and upload it to iCloud, when I stop paying for storage I know I've cracked what's on your drive.

In any case, I'd be surprised if Apple's not already leaking this information due to caching in a way that could be revealed via timing attacks.

b) It'll lead to hugely erratic pricing for consumers. E.g. let's say you download 100TB of movies from BitTorrent, now you pay almost nothing for it, but if everyone else deletes their copies pricing for you will go up.

Apple could mitigate that by never raising the price on a given chunk, but that just leaves them paying for it, and it's easily abused. Open two accounts, upload the same data, then delete it from one account, pay 1/2 for storage.

Re:Apple confirms it uses Google cloud for some of iCloud by jbuild on Monday February 26, 2018 @02:19PM (#16468122)
That’s a great solution, but at what point is it easier to just store your data yourself? If someone worried about their provider knowing some user has the same file as another user, that person shouldn’t really be trusting Google or Apple with anything.
Re:Apple confirms it uses Google cloud for some of iCloud by rmrfrmrf on Monday February 26, 2018 @07:57PM (#16470315)
Sounds like a great side-channel attack vector for law enforcement.
Re:Apple confirms it uses Google cloud for some of iCloud by Someone on Monday February 26, 2018 @12:36PM (#16467140)
”in this case it's irrelevant because Apple has access to the keys anyway”

Not completely, I would think. Google may be able to discover whether any user stores file F in iCloud by creating an iCloud account for themselves and uploading the file to it. If that doesn’t create a new file, it already was there before. Depending on what exactly Apple stores on iCloud, they may even be able to detect how many users or (unlikely) even which users store the file.

I don’t see how they could use it, and don’t think they would use it, but Google also has a large data set of email messages and attachments sent between iCloud and gmail accounts that they could somehow use to correlate activity between their gmail servers and the “iCloud on Google cloud” servers.

Re:Apple confirms it uses Google cloud for some of iCloud by mygo on Monday February 26, 2018 @06:48PM (#16470015)
Even with a salt you can still tell if a password is reused. You just have to use the same salt.
Re:Apple confirms it uses Google cloud for some of iCloud by 5x50 on Tuesday February 27, 2018 @12:53PM (#16475975)
If you are using the same salt on multiple passwords you are not doing it properly. It is supposed to be almost a nonce. 1 random salt per password.
Re:Apple confirms it uses Google cloud for some of iCloud by mygo on Tuesday February 27, 2018 @07:19PM (#16479499)
That is the standard way of doing it, yes. However not every non-standard implementation is insecure.
Re:Apple confirms it uses Google cloud for some of iCloud by snuxoll on Monday February 26, 2018 @12:09PM (#16466879)
The encryption is to protect data from snooping by the cloud provider Apple hosts the chunks on, not provide end-to-end privacy/anonymity to users from courts or Apple itself. Apple has and WILL comply with subpoena's to gain access to the contents of an iCloud account (sans Keychain where Apple has literally no way of decrypting the data themselves), as such you should never assume data in iCloud is safe from a DA or prosecutor.
Re:Apple confirms it uses Google cloud for some of iCloud by dunham on Monday February 26, 2018 @01:58PM (#16467924)
It leaks this information if you use the same key for all users. It's not clear that Apple is doing this. There is some benefit to convergent encryption with a different key per user (e.g. you dedup across multiple backups from the same user).
Re:Apple confirms it uses Google cloud for some of iCloud by tombert on Monday February 26, 2018 @02:57PM (#16468413)
This is why I like to GPG encrypt my stuff before I upload it to Dropbox. This way, it's pretty much guaranteed not to register as something easy to correlate against, and I can use Dropbox as just a free file store.

I assume some other people do this as well.

Re:Apple confirms it uses Google cloud for some of iCloud by djrogers on Monday February 26, 2018 @05:00PM (#16469361)
Data is broken in to chunks, then encrypted, then stored. Given that the AWS keys vary by user, and it’s not done file-by-file, any de-duping would be entirely coincidence and not leak anything.
Re:Apple confirms it uses Google cloud for some of iCloud by discussedbefore on Monday February 26, 2018 @01:38PM (#16467748)
Re:Apple confirms it uses Google cloud for some of iCloud by kochthesecond on Monday February 26, 2018 @05:54PM (#16469717)
The checksums might be scoped per user in some way, or they are quite brave