News for hackers. Stuff that matters.
Re:New storage classes for Google Cloud Storage by vbezhenar on Thursday October 20, 2016 @07:24AM (#12751378)
Coldline seems to be a perfect solution for personal backups. I used amazon glacier, but got hit with extremely huge bill, when I decided to retrieve my backups, so I'm not going to deal with them anymore, their retrieval pricing is absurd. If there's good UI and scripting solutions for manual and automatic backup into google coldline, I'm in.
Re:New storage classes for Google Cloud Storage by chris_st on Thursday October 20, 2016 @08:26AM (#12751648)
I highly recommend the "Arq" [1] commercial program for backing stuff up to these kinds of services. They support most of the big names (AWS, Google, Dropbox, etc.) and will probably be supporting the new Google options soon.

It does local encryption before sending your data up to the cloud.

Notably Arq restores all macOS permissions/meta-data, and there is an open-source test kit to show whether such a program does so.

It also works on Windows.

I have no relationship with the company, other than as a happy user.

[1] https://www.arqbackup.com

Re:New storage classes for Google Cloud Storage by ghshephard on Thursday October 20, 2016 @11:44AM (#12753321)
Likewise - I can't say enough great things about Arq. In particular, when I moved to Singapore, I was able to really take advantage of the gigabit line I got (for $39/month), and use the S3 storage that Amazon offers in Singapore. Looking forward to using the Google Storage in Singapore as well...
Re:New storage classes for Google Cloud Storage by astrostl on Thursday October 20, 2016 @10:46AM (#12752686)
Ditto. Amazon Cloud Drive is $60/year for unlimited storage, which makes a nice back-end.
Re:New storage classes for Google Cloud Storage by sreitshamer on Saturday October 29, 2016 @09:37AM (#12823868)
Arq supports coldline now. It also helps with creating buckets and choosing from among the new regional and multi-regional storage classes.
Re:New storage classes for Google Cloud Storage by questionr on Thursday October 20, 2016 @03:32PM (#12755361)
Arq sounds almost ideal, except its still intended more for "backup" than "storage". Its more like an Apple Time Machine.

From what I read, you can still offload data from your local machine by choosing to "archive" a directory.

But thats an extra step and I haven't read how it handles conflicting directory that are created in the future after archiving the original.

Re:New storage classes for Google Cloud Storage by chris_st on Thursday October 20, 2016 @04:22PM (#12755797)
That's an interesting use case. You ought to email them and ask about it!

My goal is just two off-site backups (AWS and Google).

Re:New storage classes for Google Cloud Storage by lobster_johnson on Thursday October 20, 2016 @03:38PM (#12755407)
Arq actually already supports the new Google options, as long as you create the bucket manually first via the Google Cloud console.
Re:New storage classes for Google Cloud Storage by matt4077 on Thursday October 20, 2016 @07:49AM (#12751502)
You can just user their command line tool, it's got an rsync mode:

gsutil -m rsync -P -d -r -x "node_modules|tmp|..."-e ~/ gs://you-will-spend-too-much-time-thinking-of-a-clever-bucket-name

(although I should expand it a bit to better handle ignoring stuff by parsing .gitignore)

Re:New storage classes for Google Cloud Storage by jon-wood on Thursday October 20, 2016 @10:40AM (#12752609)
> you-will-spend-too-much-time-thinking-of-a-clever-bucket-name

FQDNs to the rescue, I very much doubt anyone but me is going to call a bucket backups.ninjagiraffes.co.uk (and if someone does so now, well, good trolling)

Re:New storage classes for Google Cloud Storage by dekhn on Thursday October 20, 2016 @11:30AM (#12753172)
https://cloud.google.com/storage/docs/domain-name-verificati...

if you own a domain, only people who pass domain ownership verification can make buckets with that domain suffix.

Combined with https://cloud.google.com/storage/docs/hosting-static-website it means you can easily host static websites by just populating appropriately named buckets with your domain suffix.

I think this is a very cool feature.

Re:New storage classes for Google Cloud Storage by nsheridan on Thursday October 20, 2016 @06:28PM (#12756723)
I really wish AWS would introduce domain verification for 'domain-shaped' bucket names.
Re:New storage classes for Google Cloud Storage by jl6 on Thursday October 20, 2016 @07:51AM (#12751510)
Have you considered Amazon Cloud Drive if it's for personal use?
Re:New storage classes for Google Cloud Storage by vbezhenar on Thursday October 20, 2016 @08:19AM (#12751612)
$60/year is too much for me. I have around 200GB data for backup now, slowly growing. It's $0.007 * 200 * 12 = $16/year for Google cold storage. Also I'm skeptical about "Unlimited Storage", there's always a limit and I prefer to know about it beforehand.

Of course Amazon Cloud Drive looks nice for people who wants to backup their media with little effort. I'm using a bit different approach, I'm backing up my data to a home server, but I need a reliable mirror in case of emergency.

Re:New storage classes for Google Cloud Storage by jbergens on Thursday October 20, 2016 @08:39AM (#12751704)
Google Nearline seems to be $0.01 / GB / month which would be about $24 / year for you. Sounds good since you can retrieve data whenever you want without any extra cost. I would probably use that for my backups if I ran out of space on my normal storage.
Re:New storage classes for Google Cloud Storage by hga on Thursday October 20, 2016 @09:21AM (#12751911)
But per this announcement Google's new "Coldline" storage hits the AWS Glacier 0.7 cents/GB/month price point, and without Glacier's mindboggling operational and billing complexity, long delays on retrievals, and I think the particularly huge bills if you need a lot of that data all at once, i.e. for restoring a backup. (Can't remember the Glacier numbers for the latter (too complicated for me to remember), but Google makes Coldline retrieval simple, 5 cents/GB.)

In fact, it's implied they believe Coldline is the biggest new thing they're doing, for it's the first thing in the announcement they discuss in detail. It's certainly got me interested.

Re:New storage classes for Google Cloud Storage by lucaspiller on Thursday October 20, 2016 @09:15AM (#12751881)
The retrieval cost for Nearline is also $0.01/GB [0], still compared to Glacier's pricing, it makes a lot more sense.

[0] https://cloud.google.com/storage/archival/ - At the bottom

Re:New storage classes for Google Cloud Storage by Veratyr on Thursday October 20, 2016 @12:02PM (#12753485)
For the record I'm aware of people with 10s of TB in Amazon Cloud Drive without any issues. It is of course yet to be seen whether they'll pull a Microsoft and take it back.
Re:New storage classes for Google Cloud Storage by boundlessdreamz on Thursday October 20, 2016 @12:45PM (#12753915)
Well, they did make the unlimited photos plan prime only without grandfathering people in - http://www.theverge.com/2016/9/23/13027082/amazon-prints-pho...
Re:New storage classes for Google Cloud Storage by andrewbinstock on Thursday October 20, 2016 @04:42PM (#12755973)
Heads-up about Amazon Cloud Drive. From their TOS:

"We may use, access, and retain Your Files in order to provide the Services to you, enforce the terms of the Agreement, and improve our services, and you give us all permissions we need to do so. These permissions include, for example, the rights to copy Your Files, modify Your Files to enable access in different formats, use information about Your Files to organize them on your behalf."

Re:New storage classes for Google Cloud Storage by kl4m on Thursday October 20, 2016 @05:06PM (#12756171)
You are asking them to store your files and give them back to you on request, after all.
Re:New storage classes for Google Cloud Storage by bedros on Thursday October 20, 2016 @04:51PM (#12756057)
amazon has limits on the type files you store in drive, and they can terminate the service at any time without notice. That's all according to their terms of use

that's very scary if they can terminate my service and delete all my binary backups because they did not like binary files.

https://www.amazon.com/gp/help/customer/display.html/?nodeId...

Re:New storage classes for Google Cloud Storage by RJIb8RBYxzAMX9u on Thursday October 20, 2016 @07:41PM (#12757118)
IANAL, but it's just a catch-all clause so they could kick "abusers" without worrying that whatever "infraction" was not explicitly enumerated in the terms.

For comparison, CrashPlan has a similar clause (see section 11)[0].

Ditto Backblaze (see "Our Rights")[1].

I wouldn't be surprised that all "unlimited" consumer products have similar clauses. If this is a concern for you, use a metered product.

[0] https://support.code42.com/Terms_And_Conditions/End_User_Lic...

[1] https://www.backblaze.com/company/terms.html

Re:New storage classes for Google Cloud Storage by brianwski on Thursday October 20, 2016 @08:05PM (#12757220)
Disclaimer: I work at Backblaze.

For our Personal Backup product (fixed $5/month for as much data as you can keep on your laptop) your data is encrypted on your laptop BEFORE UPLOADING to Backblaze, and we have no idea what is inside your files and I assure you we don't want to know. (Look into setting your own private encryption key if you are worried at all about this.) In our 10 year history we have never once removed a customer's file because we objected to the file contents in that customer's Personal Backup because we simply don't know what is in the files.

For our other product line (B2 Cloud Storage for half a penny per GByte per month) the problem is you can have a "Private" bucket at which point we absolutely DO NOT care what you store. But if you have a "Public" bucket that is a public website. If you have public bucket serving up illegal content such as a phishing website or sharing bootleg songs or movies that you do not have legal rights to share, then we may shut you down (turn the bucket "Private" so nobody but you can get the data).

TL;DR - use our Personal Backup product or a "Private" bucket and store WHATEVER YOU WANT. But if you break the law serving up a website from Backblaze we have an obligation to shut you down.