Backblaze Storage Pod 5.0

Re:Backblaze Storage Pod 5.0 by therobot24 on Tuesday November 10, 2015 @02:48PM (#10541894)

it takes months to get everything backed up, and now the just the file lists or whatever is taking up 8GB+ on my disk (i use a smaller SSD as the primary drive so space is precious). I contacted support and their only solution is to create a new account and go through many more months of backing everything up again.

[ Parent | on HN ]

Re:Backblaze Storage Pod 5.0 by josefresco on Tuesday November 10, 2015 @03:45PM (#10542346)

Does someone from BB want to jump in here and explain why this guys "file list" could be 8GB and how re-starting the sync will fix it? Sounds like something went awry.

[ Parent | on HN ]

Re:Backblaze Storage Pod 5.0 by therobot24 on Tuesday November 10, 2015 @04:39PM (#10542731)

This is what nathan from support told me when i contacted them:

"As part of our backup process, Backblaze will run a checksum against each file before uploading it. This requires the entire bzfileids.dat file to be loaded into RAM. After a long time, or if you have an extraordinarily large number of files, the bzfileids.dat file can grow large causing the Backblaze directory to appear bloated, and use more RAM (potentially slowing down your system). In your case your bzfileids are extremely large, likely because you have a lot of files and an older backup."

here's my backblaze folder: http://imgur.com/ohqUERr (i have my temporary data drive set to a secondary drive)

[ Parent | on HN ]

Re:Backblaze Storage Pod 5.0 by kalleboo on Wednesday November 11, 2015 @01:29AM (#10545137)

> it takes months to get everything backed up

What kind of internet connection are you on? I recently reinstalled my mac from scratch (El Capitan upgrade went haywire) and had to redo my backblaze backup. I uploaded the 500 GB to Backblaze in under 24 hours.

[ Parent | on HN ]

Re:Backblaze Storage Pod 5.0 by beagle3 on Thursday November 12, 2015 @03:22PM (#10555823)

That means that you consistently had ~6MB/sec, or 50Mb/sec of upload bandwidth. That might be possible if you're on a really good 100Mb connection (or 1Gb connection), but that's not common in most of the world yet.

Also, could it be that the "re-upload" was able to detect your older copy of the files and reuse them? I can rsync terabytes in minutes over slow connections when the other side already has the files ...

[ Parent | on HN ]