News for hackers. Stuff that matters.
Re:Myspace lost all the music its users uploaded between 200... by scarface74 on Sunday March 17, 2019 @10:51PM (#19418361)
I’m not saying it isn’t dumb, but that one fat finger would have to be

aws s3 rm bucket —-recursive

It won’t let you just go into the console or delete the stack that made it if the bucket isn’t empty.

Re:Myspace lost all the music its users uploaded between 200... by VWWHFSfQ on Sunday March 17, 2019 @10:59PM (#19418387)
there was a S3 sync client that some people used that did:

    aws s3 sync --delete ./ s3://your-bucket/

The delete flag was added by just a very innocuous checkbox in the UI. The result is that it removes anything not in the source directory. Kaboom. Everything's gone. The point is you have no idea what stuff is going to do even if you think it's obvious.
Re:Myspace lost all the music its users uploaded between 200... by electroly on Monday March 18, 2019 @11:26AM (#19421844)
Have you tried this? It takes forever to clean out a bucket. At the scale we're talking about, doing this on a single thread from the CLI tool means you could go home and come back the next day and cancel it then, and you still wouldn't have made a particularly big dent in the bucket. It's really a pain in the neck to delete a whole bucket full of data when you actually want to. It's "easy" to start off a recursive delete, sure, but I think you're overestimating the "kaboom" factor.
Re:Myspace lost all the music its users uploaded between 200... by VWWHFSfQ on Monday March 18, 2019 @11:51AM (#19422115)
not every business critical bucket has petabytes of data in it
Re:Myspace lost all the music its users uploaded between 200... by electroly on Monday March 18, 2019 @01:26PM (#19423069)
This one does. We're talking about Tumblr.
Re:Myspace lost all the music its users uploaded between 200... by dahfizz on Monday March 18, 2019 @08:11AM (#19420415)
Maybe the moral is that you shouldn't rely on third party clients for mission critical stuff if you dont know what they do.
Re:Myspace lost all the music its users uploaded between 200... by VWWHFSfQ on Monday March 18, 2019 @08:38AM (#19420529)
and also have backups like a normal competent person/organization does
Re:Myspace lost all the music its users uploaded between 200... by foxtrottbravo on Monday March 18, 2019 @12:26PM (#19422501)
I know in the particular example that is something that's good advise and more or less easily done.

Do you think it would be good to extend said argument to say scp / ftp clients?

Re:Myspace lost all the music its users uploaded between 200... by bashinator on Monday March 18, 2019 @01:34PM (#19423137)
awscli is a first-party client.
Re:Myspace lost all the music its users uploaded between 200... by scarface74 on Monday March 18, 2019 @03:14PM (#19424163)
He mentioned a third party GUI wrapper on top of the CLI.
Re:Myspace lost all the music its users uploaded between 200... by PetahNZ on Monday March 18, 2019 @05:23AM (#19419668)
This would take so many hours to actually run though, probably weeks for that amount of data.
Re:Myspace lost all the music its users uploaded between 200... by itronitron on Monday March 18, 2019 @05:32AM (#19419708)
maybe someone at Tumblr can test this...
Re:Myspace lost all the music its users uploaded between 200... by Dunedan on Monday March 18, 2019 @03:51PM (#19424518)
That's not accurate.

From the S3 management console user guide[1]:

> You can delete an empty bucket, and when you're using the AWS Management Console, you can delete a bucket that contains objects. If you delete a bucket that contains objects, all the objects in the bucket are permanently deleted.

[1]: https://docs.aws.amazon.com/AmazonS3/latest/user-guide/delet...

Re:Myspace lost all the music its users uploaded between 200... by onefuncman on Tuesday March 19, 2019 @05:31AM (#19429285)
if you'd used the s3 management console, you'd know that it uses the same API as everything else, and so has to do the same list objects by page / delete a page dance just like everybody else... the only bulk optimization i can recall is the server side transfers for sync...