MongoDB Finds A Major Adopter In Craigslist

Re:MongoDB Finds A Major Adopter In Craigslist by HarrisonFisk on Monday May 16, 2011 @09:44PM (#2554963)

MongoDB is being used for historical archiving, not for the live site itself. The big reason being that changing table schemas for very large sets of old data is painful with MySQL. So the 2 billion number would be any ad/listing older than a set amount of time.

The live data is < 1 TB and is still stored in MySQL.

[ Parent | on HN ]

Re:MongoDB Finds A Major Adopter In Craigslist by jzawodn on Tuesday May 17, 2011 @01:03AM (#2555335)

Exactly.

The "set amount of time" typically hovers around 60 days, though our archiving process has been off for several months while the migration took place. So we have some catching up to do--somewhere in the neighborhood of 150 million postings, last I counted.

[ Parent | on HN ]

Re:MongoDB Finds A Major Adopter In Craigslist by biot on Tuesday May 17, 2011 @04:33AM (#2555740)

I've been hearing some good things about Riak lately and their masterless implementation seems quite interesting. Did Riak ever make your radar and, if so, what were the disadvantages that made you choose MongoDB?

Were I to guess based on the video, I would say lack of a Perl client and you'd probably end up having to roll too many of your own solutions on top of it?

[ Parent | on HN ]