News for hackers. Stuff that matters.
Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by petercooper on Tuesday June 29, 2010 @02:17AM (#1470590)
If "key value" is important, have you considered Redis? If things like Cassandra and HBase are the Lisp or Haskell of the database world, Redis is the assembler - it's crazy fast but you need to take care of your own underlying data structures (beyond strings, lists, and two types of set).
Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by strlen on Tuesday June 29, 2010 @04:04AM (#1470778)
[Disclaimer: I am a committer on Project Voldemort]

Redis is very cool (I really want to play with it - congrats to VMWare on hiring its author), but it is neither a disk-oriented system [EDIT: fixed per comment, was disk-persistent] nor (most importantly, IMO) a fully distributed system.

See a comment in this blog post for great visual guide to these systems from these two axes (disk-orientation and distribution):

http://pl.atyp.us/wordpress/?p=2929

Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by uggedal on Tuesday June 29, 2010 @04:53AM (#1470863)
Redis supports full disk persistence by adding the following values to your redis.conf:

    appendonly yes
    appendfsync always
Yes, fsyncing after every operation will be slower than fsyncing every second or so.
Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by strlen on Tuesday June 29, 2010 @04:58AM (#1470874)
Thanks, fixed it.
Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by petercooper on Tuesday June 29, 2010 @06:29AM (#1470969)
Sure, but the OP specified:

I need access to that data as quickly as possible. Writes are only going to occur quarterly.

The emphasis is on speed and writes are rare, so being disk-oriented wouldn't provide any advantages.

Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by bravura on Tuesday June 29, 2010 @02:31AM (#1470619)
I guess the main question when considering Redis is: Does the entire database fit into memory?
Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by fictorial on Tuesday June 29, 2010 @03:22AM (#1470711)
Redis supports "virtual memory".
Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by ghotli on Tuesday June 29, 2010 @09:29AM (#1471297)
My initial thoughts were for a Redis style database. It certainly won't live in memory. That's why I've been pushed towards a dynamo / bigtable approach.
Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by petercooper on Tuesday June 29, 2010 @07:37PM (#1473278)
Though, as has been raised a few times, that is not a restriction in Redis anymore.
Re:Ask HN: Cassandra, HBase, Hypertable, Voldemort. Lowest r... by riffraff on Tuesday June 29, 2010 @04:33AM (#1470822)
that would be "does the entire keyspace fit in memory?"