Re:Up to date Rust bindings for LMDB
by jszymborski on Tuesday October 01, 2024 @06:47PM
(#41715117)
Only slightly off topic, but any of these support fast concurrent writes? LMDB really slows down for me when I'm trying to write a lot to it and locking means i cant use concurrency to speed it up.
Batching helps, and if you can avoid syncing after every write that helps too. In practice I get great throughout, but then I’m OK with losing a small amount of data if my server dies during writes, as long as that doesn’t lead to corruption, which it doesn’t with MDB_NOSYNC and kernel guided fsyncing
Pure speculation on my part: maybe people are choosing Rust-based embedded key value stores like sled or redb?