News for hackers. Stuff that matters.

A comment on Building a NAS. Parent comment

Re:Building a NAS by melp on Monday April 10, 2017 @10:36PM (#14084425)
36T to CrashPlan sits on 36GB of RAM at all times... screw that. rclone never uses more than ~2GB to manage my whole 50TB dataset.

edit: Also, I'm using a SuperMicro chassis, not a Norco. I've got a section where I go into why I went with SuperMicro.

[ Parent | on HN ]
Re:Building a NAS by dom0 on Tuesday April 11, 2017 @05:13AM (#14086043)
Uhm, what exactly is crashplan doing with all that memory?
[ Parent | on HN ]
Re:Building a NAS by glenneroo on Tuesday April 11, 2017 @07:51AM (#14086794)
I wonder if it's related to the memory "issue" with their client, where exceeding 1TB/1 million files, a manual edit of the .ini file to bump the JVM memory allocation is necessary. I remember reading somewhere that it has to do with CRC checksum calculation for all the files? I've had to change the setting multiple times (currently at 8GB for ~8TB/1 million files).

https://support.code42.com/CrashPlan/6/Troubleshooting/Adjus...

[ Parent | on HN ]
Re:Building a NAS by dom0 on Wednesday April 12, 2017 @06:41AM (#14096396)
Hm, maybe give Borg a shot. For initial backups it's not exactly the fastest thing, though much better after that.
[ Parent | on HN ]
Re:Building a NAS by ValentineC on Tuesday April 11, 2017 @09:24AM (#14087459)
> rclone never uses more than ~2GB to manage my whole 50TB dataset.

How do you handle file versions with rclone?

[ Parent | on HN ]
Re:Building a NAS by melp on Tuesday April 11, 2017 @10:38AM (#14088191)
I guess that's the downside. It only syncs the latest version of every file it syncs.
[ Parent | on HN ]