Indeed, from the README: We used to rely a lot on CDB (which is a really great piece of software). It performed blazingly quick and produces compact files. We only stopped using it when our data started growing close to the 4 GB limit
Re:Sparkey – Key/value storage by Spotify
by ptramo on Tuesday September 03, 2013 @06:20PM
(#6324246)
A 64-bit port of cdb isn't too hard: https://github.com/pcarrier/cdb64
[0] http://en.wikipedia.org/wiki/Cdb_%28software%29