News for hackers. Stuff that matters.
Re:NoSQL: If only it was that easy by davidw on Wednesday August 05, 2009 @04:07AM (#743021)
I thought he wanted to know what I did. Since I already said I don't know much about this problem domain, I'd be curious why it's a problem when you start adding servers.
Re:NoSQL: If only it was that easy by qhoxie on Wednesday August 05, 2009 @04:19AM (#743032)
One such bad situation would be if you have numeric keys that you shard based on a mod 2. You do this because you want to distribute data between 2 servers, so one will get all even keys and the other will get the odd keys.

A few months down the line your load gets so high that you need to add a third server, but your sharding mechanism is based on mod 2 - so you need to hack around this in one of many ways to utilize the third server effectively.

Make sense?

Re:NoSQL: If only it was that easy by davidw on Wednesday August 05, 2009 @04:29AM (#743039)
So don't people just publish client libs that handle the details for you? It doesn't seem like an unsurmountable problem, but once again, I've never dealt with it in practice.
Re:NoSQL: If only it was that easy by qhoxie on Wednesday August 05, 2009 @04:39AM (#743056)
So don't people just publish client libs that handle the details for you?

Sometimes, but oftentimes sharding issues are unique enough that they require custom solutions when the backend technology does not support it natively.

Re:NoSQL: If only it was that easy by davidw on Wednesday August 05, 2009 @05:15AM (#743084)
And these sharding issues don't happen with the things he marks as "scales!"?
Re:NoSQL: If only it was that easy by qhoxie on Wednesday August 05, 2009 @05:22AM (#743090)
That is correct. Things like S3 can expand without issue, and others like Voldemort handle partitioning data natively.