Re:Pebble: A RocksDB Inspired Key-Value Store Written in Go
by tyingq on Tuesday September 15, 2020 @03:48PM
(#24485931)
There's some notes on that here: https://github.com/cockroachdb/pebble/blob/c39589c8cb36d95df...
[ Parent
| on HN ]
Re:Pebble: A RocksDB Inspired Key-Value Store Written in Go
by petermattis on Tuesday September 15, 2020 @04:17PM
(#24486244)
The TLDR is that the GC did cause problems so we had to avoid it for the block cache. Luckily we were able to do so without exposing the complexity in the API. Not for the faint of heart. Don't try this at home kids.
Re:Pebble: A RocksDB Inspired Key-Value Store Written in Go
by throwdbaaway on Wednesday September 16, 2020 @02:52AM
(#24490190)
Any reason why the block cache needs to be 10s of GB in size? Cassandra, for example, usually has a rather small key cache on heap, and then just relies on the kernel page cache. I don't have experience with cockroach, it looks like the block cache is similar to cassandra row cache, which can be configured to be on heap or off heap, but usually not beneficial to enable.