News for hackers. Stuff that matters.
Re:NoSQL: If only it was that easy by davidw on Wednesday August 05, 2009 @01:23AM (#742901)
The subjunctive: if only it were that easy. Actually, it is in English because we only ever really notice it in a few places...

Grammar nitpickery aside, good article. Is client-side hashing really that big a deal? I don't know from first hand experience because I've never bothered with these things yet.

Re:NoSQL: If only it was that easy by qhoxie on Wednesday August 05, 2009 @01:59AM (#742927)
Just to clarify, client-side == application-side, or the application as a client of the database.

Is client-side hashing really that big a deal?

No, it's not that big of a deal, but I tend to feel that any layer of logic that can be done on the DB end rather than the implementation end is better off in the former. Voldemort is a good example, as noted in the article.

Re:NoSQL: If only it was that easy by bjclark on Wednesday August 05, 2009 @02:01AM (#742929)
It's not a big deal when you do it the first time. It's a big deal when you need to start adding servers. What do you do?
Re:NoSQL: If only it was that easy by davidw on Wednesday August 05, 2009 @03:57AM (#743014)
I don't have scaling problems, I don't have sites that big, yet.
Re:NoSQL: If only it was that easy by qhoxie on Wednesday August 05, 2009 @04:05AM (#743020)
He's pointing out a situation where it becomes a bigger deal, to answer your question. While there are solutions in practice for this situation, it can be painful.
Re:NoSQL: If only it was that easy by davidw on Wednesday August 05, 2009 @04:07AM (#743021)
I thought he wanted to know what I did. Since I already said I don't know much about this problem domain, I'd be curious why it's a problem when you start adding servers.
Re:NoSQL: If only it was that easy by qhoxie on Wednesday August 05, 2009 @04:19AM (#743032)
One such bad situation would be if you have numeric keys that you shard based on a mod 2. You do this because you want to distribute data between 2 servers, so one will get all even keys and the other will get the odd keys.

A few months down the line your load gets so high that you need to add a third server, but your sharding mechanism is based on mod 2 - so you need to hack around this in one of many ways to utilize the third server effectively.

Make sense?

Re:NoSQL: If only it was that easy by davidw on Wednesday August 05, 2009 @04:29AM (#743039)
So don't people just publish client libs that handle the details for you? It doesn't seem like an unsurmountable problem, but once again, I've never dealt with it in practice.
Re:NoSQL: If only it was that easy by qhoxie on Wednesday August 05, 2009 @04:39AM (#743056)
So don't people just publish client libs that handle the details for you?

Sometimes, but oftentimes sharding issues are unique enough that they require custom solutions when the backend technology does not support it natively.

Re:NoSQL: If only it was that easy by davidw on Wednesday August 05, 2009 @05:15AM (#743084)
And these sharding issues don't happen with the things he marks as "scales!"?
Re:NoSQL: If only it was that easy by qhoxie on Wednesday August 05, 2009 @05:22AM (#743090)
That is correct. Things like S3 can expand without issue, and others like Voldemort handle partitioning data natively.
Re:NoSQL: If only it was that easy by mtw on Wednesday August 05, 2009 @01:30PM (#743827)