News for hackers. Stuff that matters.
Re:Rclone banned from Amazon Drive for having the encrypted ... by brandur on Monday May 22, 2017 @02:30PM (#14395847)
Yeah, this is a hard one. There are users on /r/DataHoarder/ that claim to have uploaded literally 100s of (encrypted) TBs to Cloud Drive, which is plainly unsustainable and abusive.

On the other hand, they've also killed the product for a lot of more legitimate users as well. The Amazon web interface and apps for Cloud Drive are obnoxiously terrible, and Rclone really is just a better way to use it. I've been using it to sync 10s of GBs of photos between all my different computers, but with Rclone unavailable, I'll have to fall back to Google Drive, S3, or some other option (the unlimitedness of Cloud Drive was good peace of mind).

I'll be keeping an eye on it over the next few weeks to see whether shipping a binary with OAuth secrets was actually the reason for the ban, or just a pretext for getting the Rclone users off the service (personally, I suspect the latter).

Re:Rclone banned from Amazon Drive for having the encrypted ... by mwambua on Monday May 22, 2017 @03:00PM (#14396063)
I just use it to upload daily encrypted backups of my mail-server (< 500MB per month)... so I wouldn't mind if they set some reasonable limit to encrypted uploads (say 1-10TB).

I feel like anyone who's actually uploading personal content and who isn't uploading media files that are amenable to deduplication would be comfortable with some threshold as well.

Re:Rclone banned from Amazon Drive for having the encrypted ... by wolfgke on Monday May 22, 2017 @03:20PM (#14396200)
> so I wouldn't mind if they set some reasonable limit to encrypted uploads (say 1-10TB).

How is Amazon supposed to distinguish between encrypted and non-encrypted data that you upload?

Re:Rclone banned from Amazon Drive for having the encrypted ... by pinum on Monday May 22, 2017 @03:27PM (#14396253)
A heuristic. No common magic header and poor compressibility? Likely encrypted.
Re:Rclone banned from Amazon Drive for having the encrypted ... by sillysaurus3 on Monday May 22, 2017 @03:35PM (#14396307)
Since encrypted data is indistinguishable from random noise, I think poor compressibility is actually zero compressibility, isn't it?

There are tools to search for TrueCrypt / other encrypted partitions on disks, so it's a solved problem to detect encrypted data.

It would be unfortunate if services ban the ability to upload encrypted secrets, though. On the other hand, that'd be good for Tarsnap. I wonder how much it'd cost to store 10TB on it?

Re:Rclone banned from Amazon Drive for having the encrypted ... by dorgo on Monday May 22, 2017 @04:49PM (#14396823)
The first billion of digits of Pi might look pretty random, but there might be a short program which genrates them - which can be considered a compressed form. In general, it is impossible to decide how good a given string might be compressed. https://en.wikipedia.org/wiki/Kolmogorov_complexity
Re:Rclone banned from Amazon Drive for having the encrypted ... by foota on Tuesday May 23, 2017 @06:43AM (#14400214)
Might be a short program that generates them? I'm going to go ahead and file that in the understate of the century folder.
Re:Rclone banned from Amazon Drive for having the encrypted ... by icebraining on Monday May 22, 2017 @03:57PM (#14396457)
Since encrypted data is indistinguishable from random noise, I think poor compressibility is actually zero compressibility, isn't it?

I don't think so. Random noise can take any form - even of a string composed entirely of zeros, which would be trivially compressed. It's just very unlikely that it'll actually be compressible.

Re:Rclone banned from Amazon Drive for having the encrypted ... by Dylan16807 on Monday May 22, 2017 @05:54PM (#14397241)
Random noise can't really take any form when you apply the implicit restriction of your search fitting within finite time and space.
Re:Rclone banned from Amazon Drive for having the encrypted ... by icebraining on Monday May 22, 2017 @06:31PM (#14397410)
I don't get what you're saying. Searching? For what?
Re:Rclone banned from Amazon Drive for having the encrypted ... by Dylan16807 on Monday May 22, 2017 @07:37PM (#14397708)
The definition of a random number is in the process of generation. You have to actually generate random numbers if you want to have a random number that meets some criteria. And even with impossibly vast resources, you will never find a random megabyte that compresses well.
Re:Rclone banned from Amazon Drive for having the encrypted ... by icebraining on Monday May 22, 2017 @07:59PM (#14397802)
Well, sure, that's what I wrote: "it's very unlikely that it'll actually be compressible." But it's incorrect to claim that random numbers are by definition non-compressible.
Re:Rclone banned from Amazon Drive for having the encrypted ... by sillysaurus3 on Monday May 22, 2017 @09:06PM (#14398073)
It was in the context of encryption. Even a 64 digit random number is very unlikely to be compressible, and 64 bytes is about as small of an encrypted partition as you'll ever have.
Re:Rclone banned from Amazon Drive for having the encrypted ... by sillysaurus3 on Monday May 22, 2017 @07:18PM (#14397632)
It'd take longer than the universe has left to find a string of N zeroes by generating random numbers, for sufficiently large N. And N is surprisingly small.
Re:Rclone banned from Amazon Drive for having the encrypted ... by icebraining on Monday May 22, 2017 @07:59PM (#14397803)
Sure, but not zero.
Re:Rclone banned from Amazon Drive for having the encrypted ... by Dylan16807 on Monday May 22, 2017 @10:42PM (#14398444)
Yes zero. As zero as zero can possibly be, measuring with the most precise instruments possible. There's an infinitely better chance of both of us being struck by lightning and imagining you found such a number randomly.

It wouldn't be zero in certain math worlds. It is zero in the real universe.

Re:Rclone banned from Amazon Drive for having the encrypted ... by saurik on Monday May 22, 2017 @02:33PM (#14395873)
So why not just take apart the official apps for Google Cloud Drive and use whatever API and authority into has to build your alternative client?
Re:Rclone banned from Amazon Drive for having the encrypted ... by brandur on Monday May 22, 2017 @10:19PM (#14398367)
The nice thing about Rclone is that it already supports Google Cloud Drive (and a host of other providers) so the technology isn't the problem.

I'm lamenting Amazon Cloud Drive in particular because it was the best deal. $60 a year for unlimited storage and with no caveats (or so it seemed before last week).

Re:Rclone banned from Amazon Drive for having the encrypted ... by saurik on Tuesday May 23, 2017 @03:13AM (#14399430)
I am sorry, "Google" was clearly a typo: I meant "Amazon". You do not need Amazon's permission to write a client that targets their API.
Re:Rclone banned from Amazon Drive for having the encrypted ... by Oletros on Monday May 22, 2017 @02:35PM (#14395889)
If a service claims that they provide UNLIMITED storage why using it is abusing?
Re:Rclone banned from Amazon Drive for having the encrypted ... by dmd on Monday May 22, 2017 @02:52PM (#14396009)
HOPSFIELD No, these are entries for McDonald's Sweepstakes. No purchase necessary. Enter as often as you want. So, I am.

CHRIS Really?

HOPSFIELD This box makes it one million, six hundred thousand. I should win thirty two point six percent of the prizes, including the car.

CHRIS Kind of takes the fun out of it, doesn't it?

HOPSFIELD I suppose so. But they set up the rules, and lately, I have come to realize that I have certain materialistic needs.

Re:Rclone banned from Amazon Drive for having the encrypted ... by tzs on Monday May 22, 2017 @03:55PM (#14396447)
For those who don't recognize it, that's from the movie "Real Genius". For those who don't quite remember it that way, that looks like it is the version from an early version of the script. By the time the movie was actually made it was changed to Frito-Lay from McDonald's, Hopsfield was changed to Hollyfeld, and the above dialog was altered slightly.

That scene is based on a real life incident which in fact involved a McDonald's sweepstakes and Caltech students entering over a million times: [1]

Since everyone knew that the school in the movie, Pacific Tech, was meant to be a thinly disguised Caltech (it only became Pacific Tech when Caltech objected), and McDonald's had not been happy with the Caltech sweepstakes prank and probably would not want it brought up, my guess is that one or both of McDonalds and Caltech asked for the change.

Changing it to Frito-Lay is an interesting choice, because six years before the McDonald's sweepstakes, a group of Caltech students tried mass entry on a Frito-Lay sweepstakes, but apparently were not as successful.

[1] http://hoaxes.org/archive/permalink/the_caltech_sweepstakes_...

Re:Rclone banned from Amazon Drive for having the encrypted ... by dmd on Monday May 22, 2017 @04:05PM (#14396509)
Crap. I knew something seemed off about it. Thank you!

====

Lazlo: No. These are entries into the Frito-Lay Sweepstakes. "No purchase necessary, enter as often as you want" - so I am.

Chris: That's great! How many times?

Lazlo: Well, this batch makes it one million six hundred and fifty thousand. I should win thirty-two point six percent of the prizes, including the car.

Chris: That kind of takes the fun out of it, doesn't it?

Lazlo: They set up the rules, and lately I've come to realize that I have certain materialistic needs.

Re:Rclone banned from Amazon Drive for having the encrypted ... by burkaman on Monday May 22, 2017 @02:38PM (#14395913)
abuse: use (something) to bad effect or for a bad purpose; misuse.

Abuse doesn't mean breaking the rules. It's like going to an all-you-can-eat buffet and staying for a week. Or taking a job with unlimited vacation time and coming to work once a month.

Re:Rclone banned from Amazon Drive for having the encrypted ... by milcron on Monday May 22, 2017 @02:44PM (#14395954)
They should declare limits, then.
Re:Rclone banned from Amazon Drive for having the encrypted ... by nkrisc on Monday May 22, 2017 @02:59PM (#14396054)
I bet in the ToS there are likely limits spelled out, or barring that, a clause that grants Amazon to right to shut you down if they unilaterally decide you're "abusing" the system.
Re:Rclone banned from Amazon Drive for having the encrypted ... by Oletros on Monday May 22, 2017 @03:19PM (#14396189)
I have looked at the TOS in Spain and you won the bet :)

They can shut down your account for the reason you stated

Re:Rclone banned from Amazon Drive for having the encrypted ... by Dylan16807 on Monday May 22, 2017 @05:57PM (#14397260)
Yeah, never make a bet that a company doesn't have a vaguely worded way to kick off whoever they want at any time.

But it would be nicer for everyone if they could just honestly state a number of TB.

Re:Rclone banned from Amazon Drive for having the encrypted ... by eli on Monday May 22, 2017 @03:09PM (#14396113)
There are: you can only use approved third-party apps to connect to the service. This one is no longer approved.
Re:Rclone banned from Amazon Drive for having the encrypted ... by Oletros on Monday May 22, 2017 @02:41PM (#14395931)
Then we agree to disagree.
Re:Rclone banned from Amazon Drive for having the encrypted ... by burkaman on Monday May 22, 2017 @02:48PM (#14395984)
What do we disagree about?
Re:Rclone banned from Amazon Drive for having the encrypted ... by Oletros on Monday May 22, 2017 @02:56PM (#14396036)
I disagree with you in that it is a misuse.

What Amazon should do, as Microsoft should have been done in the case of the unlimited Onedrive offer is putting some clause of reasonable use.

When some company offers an unlimited resource, some of the customers will use it to upload/download/etc a lot.

Re:Rclone banned from Amazon Drive for having the encrypted ... by petepete on Monday May 22, 2017 @02:41PM (#14395935)
Technically it's not. Hoarding for hoarding's sake is a waste of a obviously limited resource, though.
Re:Rclone banned from Amazon Drive for having the encrypted ... by wolfgke on Monday May 22, 2017 @03:23PM (#14396223)
Being waste does not imply being abuse.
Re:Rclone banned from Amazon Drive for having the encrypted ... by dorgo on Monday May 22, 2017 @04:55PM (#14396870)
Wait, the resource is UNLIMITED, isn't it? At least it is sold as unlimited.