Re:Encrypted Backup Shootout
by andrewchambers on Sunday January 03, 2021 @12:04AM
(#25619622)
As the author, I totally agree. Especially for the deduplication benchmark there are so many variables that affect it that is definitely is worth restating.
That being said, I am quite confident the results are accurate and don't mind other people running their own tests.
Question: did you unmount/mount the source filesystem between tests? When the size of data is less than RAM you are measuring cache speed, not so much disk speed. (And yes I realize that you have SSDs.)
Re:Encrypted Backup Shootout
by andrewchambers on Monday January 04, 2021 @09:12PM
(#25641214)
source filesystem was also ramfs for these.
This happens organically. If there is a benchmark the author doesn't use, then they won't be able to improve bupstash's performance on it.
The old saying is "you manage what you measure"
Re:Encrypted Backup Shootout
by andrewchambers on Sunday January 03, 2021 @02:46AM
(#25620308)
This is true, a few months ago bupstash was half the speed of restic for 'put' operations, because of my benchmarking efforts It is now faster.
I did have the benefit of being able to publish my benchmarks at the time of my choosing.
However as someone else wrote, these are the metrics the author chose, they make bupstash the clear winner, and he wrote that program. So, keep that in mind.
Still, very nice presentation.