Re:Sparkey – Key/value storage by Spotify
by slynux on Monday September 02, 2013 @08:37AM
(#6314849)
This looks interesting. Can be used for deduplication by keeping this hash table on disk for large amount of data
I wrote something like this to optimize disk seeks heavily by returning a reference of 8 byte and keeping a hashtable in memory. A mostly-append only records store that allowing mutations of same key and by rounding size of blobs by power of 2. Written to optimize storage layer for Membase.
I wrote something like this to optimize disk seeks heavily by returning a reference of 8 byte and keeping a hashtable in memory. A mostly-append only records store that allowing mutations of same key and by rounding size of blobs by power of 2. Written to optimize storage layer for Membase.
https://github.com/t3rm1n4l/lightkv