News for hackers. Stuff that matters.
Re:NoSQL Took Away The Relational Model And Gave Nothing Back by jbooth on Friday October 29, 2010 @07:37PM (#1849512)
Write cache is useful of course but it doesn't make random reads any faster. If your dataset is too big to cache, disk latency becomes your limiting factor. The question then becomes how to most effectively deploy as many spindles as possible in your solution - SANs are one way, sharding/distribution across multiple nodes another.
Re:NoSQL Took Away The Relational Model And Gave Nothing Back by fleitz on Friday October 29, 2010 @11:08PM (#1849972)
No, you would never waste write cache on random reads, instead you'd buy more RAM for your server. Why would anyone ever buy a whole new chassis, CPU, drives, etc when all you need is more RAM? As for how to effectively deploy spindles the answer is generally external drive enclosures. Generally you can put a rack of disks and save a 2-4U for the server.
Re:NoSQL Took Away The Relational Model And Gave Nothing Back by jbooth on Sunday October 31, 2010 @12:44PM (#1853581)
I said "where it's too big to cache" -- that means too big for RAM, aka >50GB or >200GB depending on what kind of server you have.
Re:NoSQL Took Away The Relational Model And Gave Nothing Back by mmt on Sunday October 31, 2010 @09:19AM (#1853201)
SANs are one way,

Agreed, if you include fast interconects like SAS and exclude the network[1] requirement of SANs.

sharding/distribution across multiple nodes another.

I disagree, for the sam reason that doing so with iSCSI over ethernet isn't: too much added latency.

Infiniband may help, but I have yet to try it empirically.

[1] Switching/routing, multiple initiators, distances longer than a few dozen meters.