Pebble: A RocksDB Inspired Key-Value Store Written in Go

Re:Pebble: A RocksDB Inspired Key-Value Store Written in Go by djhworld on Tuesday September 15, 2020 @03:41PM (#24485833)

Really enjoyed reading this, thanks.

Would be interested to see if the garbage collector has presented any problems when running in production

[ Parent | on HN ]

Re:Pebble: A RocksDB Inspired Key-Value Store Written in Go by tyingq on Tuesday September 15, 2020 @03:48PM (#24485931)

There's some notes on that here: https://github.com/cockroachdb/pebble/blob/c39589c8cb36d95df...

[ Parent | on HN ]

Re:Pebble: A RocksDB Inspired Key-Value Store Written in Go by petermattis on Tuesday September 15, 2020 @04:17PM (#24486244)

The TLDR is that the GC did cause problems so we had to avoid it for the block cache. Luckily we were able to do so without exposing the complexity in the API. Not for the faint of heart. Don't try this at home kids.

[ Parent | on HN ]

Re:Pebble: A RocksDB Inspired Key-Value Store Written in Go by throwdbaaway on Wednesday September 16, 2020 @02:52AM (#24490190)

Any reason why the block cache needs to be 10s of GB in size? Cassandra, for example, usually has a rather small key cache on heap, and then just relies on the kernel page cache. I don't have experience with cockroach, it looks like the block cache is similar to cassandra row cache, which can be configured to be on heap or off heap, but usually not beneficial to enable.

[ Parent | on HN ]