Re:Why MongoDB is a bad choice for storing our scraped data
by threeseed on Tuesday May 14, 2013 @04:41PM
(#5707933)
One issue is that many of these points are design characteristics of MongoDB and should have been known before hand. I am not criticising but it's almost like you did zero research before hand.
Transactions for example have never existed in MongoDB and joins doesn't really make much sense.
Re:Why MongoDB is a bad choice for storing our scraped data
by j-kidd on Tuesday May 14, 2013 @05:40PM
(#5708468)
Perhaps they did their research on MongoDB and knew all the limitations, but thought to themselves "meh, I can solve all that in the application code", and eventually found out it wasn't so easy to handle transactions and joins in the code?
After all, developers are rather susceptible to the "don't tell me I can't do that" behavior.
Re:Why MongoDB is a bad choice for storing our scraped data
by brasetvik on Tuesday May 14, 2013 @10:43AM
(#5705150)
How was the evaluation process that led to using MongoDB in the first place?
At some point you must have compared it to, say, Postgres – which is what the section before the summary hints to.
FWIW, we still use Mongo in other internal applications, it's just not the right choice for our crawl data storage backend.