News for hackers. Stuff that matters.
Re:Fighting The NoSQL Mindset by stingraycharles on Wednesday March 24, 2010 @05:40PM (#1216967)
I'm getting more and more annoyed by these kind of articles. Why are people talking about NoSQL and relational databases as if they're solving the same problems? There is no "NoSQL" mindset to fight against, and there is no "RDBMS" mindset to fight against: the only mindset to fight against, is a mindset that says a silver bullet exists.
Re:Fighting The NoSQL Mindset by wvenable on Wednesday March 24, 2010 @07:08PM (#1217153)
> Why are people talking about NoSQL and relational databases as if they're solving the same problems?

If you can switch from one to the other and back again, how are they not solving the same problems?

Re:Fighting The NoSQL Mindset by sjs on Wednesday March 24, 2010 @09:29PM (#1217432)
used to solve a problem != meant to solve a problem

Let's bring up the age-old vehicle analogy. Any vehicle fundamentally solves the the same problem but that's naïve outlook that doesn't acknowledge any specific use-cases. I can drive a truck down the street to get a Coke or ride my bicycle across Canada but that doesn't mean bicycles and trucks are meant to solve the same problem. The differences are obvious when you need to move a pallet of Coke (or 50).

Re:Fighting The NoSQL Mindset by scotty79 on Wednesday March 24, 2010 @09:44PM (#1217457)
What the stuff is "meant for" is often not important in real life situations.

If you have pallet of Coke to move, a bike and no driving licence that you don't care what the bike was meant for.

If you have to hammer a nail but you only have pilers in your close vicinity you hammer it with pilers and don't care what inventors of pilers meant them for.

I'm not trying to draw any parallels to RDBMS vs NoSQL just pointing out that what often matters in real life is what problems are solved with which tools and why. What the tools were meant for is pie in the sky.

Re:Fighting The NoSQL Mindset by sjs on Thursday March 25, 2010 @12:40AM (#1217744)
For legacy stuff that's true. For new projects we can and should make better decisions (if politics aren't in the way). Many DB systems are free and open source. If you have Unix servers you can choose from PostgreSQL, MySQL, Cassandra, Riak, CouchDB, MongoDB, Voldemort, etc. There is no reason not to choose the right tool for the job. You can assess them all if you have the time and resources.

It's not the physical world and we basically always have whichever tool we need available to us. I mainly use open source software so that may not be true for everyone I suppose. That's their choice though.

Re:Fighting The NoSQL Mindset by josephruscio on Wednesday March 24, 2010 @07:21PM (#1217182)
Just because you can pound a screw into the wall with a hammer doesn't mean it solves the same problem as a screwdriver.
Re:Fighting The NoSQL Mindset by wvenable on Wednesday March 24, 2010 @07:30PM (#1217200)
And just because you've got a clever saying doesn't mean we aren't just dealing the two different kinds of screw drivers. That's the whole point here.
Re:Fighting The NoSQL Mindset by rosser on Wednesday March 24, 2010 @08:19PM (#1217304)
Just because there's overlap in the problem domains the two classes of tools can be used for does not make them fully interchangeable. If you use a NoSQL tool for transaction processing, you're probably doing it wrong; if you use an RDBMS to house vast amounts of schema-less data, you're probably also doing it wrong. Yes, exceptions exist for every rule, but in the grand Venn diagram of applicability of NoSQL and RDBMSen, there are huge areas that don't overlap. You ignore those areas at your own peril.
Re:Fighting The NoSQL Mindset by wvenable on Thursday March 25, 2010 @12:42AM (#1217747)
In this case, is the data schema-less? They started with a defined schema and maybe now they don't. Your data defines the tool, but you define the data.

I can store JSON in a MySQL column and you'd say I'm using the wrong tool. But I decided to define a schema instead, then I'm using the right tool? It's pretty arbitrary. Some requirements do lean one way or the other but most of the time there's not much of a difference.

The areas where clearly an RDBMS is the correct solution or where NoSQL is clearly the correct solution aren't an issue. I think there are huge areas that do overlap. NoSQL is being advocated in far more situations than just where it's clearly the correct solution.

Re:Fighting The NoSQL Mindset by josephruscio on Wednesday March 24, 2010 @10:52PM (#1217557)
My point wvenable, is that we are absolutely not dealing with two different kinds of screw drivers here.

Yes they both store "data", but there are types of data that one is well suited to deal with, and alternative types of data that the other one is better for. On my team we've already split out data into two sets, one that lives in ACID RDBMS and one that lives in NoSQL.

If you are dead set in using one solution for everything, my pity for you.

Re:Fighting The NoSQL Mindset by nhebb on Wednesday March 24, 2010 @10:02PM (#1217492)
NoSQL vs. RDBMS debates are like traffic accidents. I slow down to look, but I'm happy I'm not involved.
Re:Fighting The NoSQL Mindset by CWIZO on Wednesday March 24, 2010 @05:54PM (#1217003)
I agree with you! And on that note I would like to see more articles that describe problems that NoSQL stuff is good at. This is probably the main reason why there is so much confusion. Everybody is talking about how great cassandra/mongodb/couchdb/... is, but nobody tells you where and how to actually use it.
Re:Fighting The NoSQL Mindset by drhodes on Wednesday March 24, 2010 @10:09PM (#1217503)
What I'd like to see are articles that discuss design techniques. Like, how to incrementally develop a key store db without inconsistencies? There's no schema so .. I'm worried about partial records after adding values to the non-schema.

First these addresses didn't have a zipcode field, but now they do. What about relationships between records, isn't there going to be redundant data? What if the user changes their email in the account record, do I have to manually update their contact record? This is what foreign keys are for. OMG, Where am I ... Where's the exit? We're all gonna die!

That's basically what I go through every time I think about it. It's a big scary fully loaded gnarly nested hash table aimed directly at my foot.

Re:Fighting The NoSQL Mindset by CWIZO on Thursday March 25, 2010 @03:45AM (#1217940)
That's exactly how I feel, and so far I haven't read a single thing that would clear this things up for me. And I read pretty much everything about this topic that I get my hands on. I'm really egger to learn this stuff, to know where to use it, so I could use it in my projects where appropriate. Somebody who truly gets NoSQL and has use it, should really really write something on this subject.
Re:Fighting The NoSQL Mindset by Nelson69 on Thursday March 25, 2010 @10:26AM (#1218498)
Yes! That's the same stuff I've been smelling. I look at stuff like documents Google has published and Hadoop and I do think to myself that map-reduce and some of the massively distributed stuff could potentially teach RDBMs some new tricks. Then I see these articles and they're all about someone converting a blog from MySQL to MongoDB.

I'd love to see the technical details of how Digg used MySQL, why it was slow and why NoSQL is better, how they use it. The more of this I see and the less real information the more I think they didn't know what they were doing in the first place.

Re:Fighting The NoSQL Mindset by dagheti on Wednesday March 24, 2010 @05:54PM (#1217002)
Your criticism of this article is off the mark (though it may apply to other articles). The entire point of this article is that he is trying to replicate the exact same problem that Digg was reporting using a different RDBMS and discussing what that means.

Maybe his numbers are off and his technique is wrong, but this article isn't making a one-sized-fits-all mistake.

Re:Fighting The NoSQL Mindset by tristan_juricek on Wednesday March 24, 2010 @06:13PM (#1217053)
Uh, using language like "bottom-feeder RDBMS" and saying that an engineering team is using it "horribly incorrectly on clearly comically deficient hardware" makes this article highly biased, and trollish.

It's pretty clear that this guy things Digg is a bunch of idiot engineers - I mean, why else allude to "rudimentary comp. sci. knowledge"?

These articles might have a central point, but when it's surrounded by a bunch of opinion, it like watching TV news (e.g., Fox News). The real information gets drowned out.

Re:Fighting The NoSQL Mindset by wvenable on Wednesday March 24, 2010 @06:57PM (#1217128)
MySQL is a good product, but it does have some significant failings when it comes to getting top-notch performance out of indexes.

Digg's description of their entire setup seems a bit unusual -- from how they've defined their tables to their query methods. It seems at least somewhat likely that they were not making optimal use of their technology.

I'd be curious what the traffic/content difference between Digg and Stackoverflow is. Stackoverflow uses an architecture very similar to what Forbes proposes here and they have plenty of capacity on rather unremarkable hardware.

Re:Fighting The NoSQL Mindset by jbellis on Wednesday March 24, 2010 @09:05PM (#1217396)
I would bet that SO has several orders of magnitude less traffic than Digg.
Re:Fighting The NoSQL Mindset by ratsbane on Wednesday March 24, 2010 @09:25PM (#1217429)
Looking at Alexa's numbers for a rough comparison of pageviews it looks like Digg gets about 10x as many as SO:

http://www.alexa.com/siteinfo/stackoverflow.com#trafficstats

Re:Fighting The NoSQL Mindset by gill_bates on Wednesday March 24, 2010 @11:15PM (#1217608)
So while SO runs on a minimal amount of closet-room hardware efficiently and without incident, Digg has heroics and clusters and scale-outs and all sorts of drama to handle just 10x the load? I'm not sure what angle you were coming from, but that makes Digg look like clowns.
Re:Fighting The NoSQL Mindset by skorgu on Thursday March 25, 2010 @08:39PM (#1219935)
Not saying that Digg aren't clowns but the traffic balance makes a huge difference. It's not implausible that Digg has an enormously bigger fraction of writes to reads than SO does which changes the scaling dynamics considerably.

Edit: To expand I'd imagine SO serves a lot of static "how do I" google hits for logged-out users which is about as easy to serve as it gets. Digg puts a higher emphasis on the logged in experience and commenting which reduces the ability to cache.

Re:Fighting The NoSQL Mindset by scotty79 on Wednesday March 24, 2010 @09:48PM (#1217467)
Why thinking that other people are stupid is such prevalent? It leads to so many misunderstandings.
Re:Fighting The NoSQL Mindset by Devilboy on Wednesday March 24, 2010 @09:33PM (#1217438)
MySQL is at the bottom of the pile of what qualifies as "RDBMS" so the bottom-feeder comment might be trollish but it's not flat out wrong.
Re:Fighting The NoSQL Mindset by henriklied on Wednesday March 24, 2010 @05:52PM (#1216998)
I do not have the vocabulary to explain how much I agree with you. Haven't we gotten to the point where people understand what "use the tool that fits your need" means?