Re:What database would you use to store (min) 10 billion obj...
by antirez on Friday May 08, 2009 @06:52AM
(#599465)
Any KV store can do the trick, just make sure to use multiple machines via some for of partitioning (for example consistent hashing).
Redis is reported to hold 300 million keys on a single 64bit machine with 64 GB of RAM, so you need around 7-10 Redis servers in this configuration: an object for every top-object with value including the serialized version of the other 10 objects. All this assuming that values will not be too big.
Redis is reported to hold 300 million keys on a single 64bit machine with 64 GB of RAM, so you need around 7-10 Redis servers in this configuration: an object for every top-object with value including the serialized version of the other 10 objects. All this assuming that values will not be too big.