News for hackers. Stuff that matters.

A comment on A Distributed File System in Go Cut Average Metadata Memory Usage to 100 Bytes. Parent comment

Re:A Distributed File System in Go Cut Average Metadata Memo... by KaiserPro on Friday February 23, 2024 @05:11AM (#39478916)
The next bit:

> Its metadata engine uses an all-in-memory approach and achieves remarkable memory optimization

Sounds like a fun thing to recover after a crash.

[ Parent | on HN ]
Re:A Distributed File System in Go Cut Average Metadata Memo... by ted_dunning on Friday February 23, 2024 @05:21PM (#39486900)
They have a blog on that:

https://juicefs.com/en/blog/engineering/increase-performance...

[ Parent | on HN ]
Re:A Distributed File System in Go Cut Average Metadata Memo... by daviesliu on Sunday February 25, 2024 @05:55AM (#39499722)
This post said another topic: how to backup the metadata of JuiceFS in readable format (JSON) and restore it into an empty database.
[ Parent | on HN ]
Re:A Distributed File System in Go Cut Average Metadata Memo... by daviesliu on Sunday February 25, 2024 @05:53AM (#39499708)
The recover process is similar to what a database does after a crash, it loads the recent snapshot in disk and apply any newer transaction logs.
[ Parent | on HN ]