News for hackers. Stuff that matters.
Re:Why I Migrated Away From MongoDB by gregjor on Monday September 17, 2012 @03:32PM (#4534393)
I'll add that email and Facebook postings and Instagram photos don't require the same kind of data consistency and durability that medical records, bank transactions, or rail car movements require. If Google loses some old emails or Facebook loses the last thousand "likes" on a Jersey Shore fan page that's not much of a catastrophe, and they don't guarantee their data anyway. For those use cases Mongo or Cassandra et al. may be the right fit.

I work on a app that stores documents (PDFs) in Amazon S3 containers, and sometimes those documents get lost or inaccessible for some reason. We have backups for those. The only consistency requirement there is that the PDF opens and the name matches the name in the RDBMS. That's a much lower bar for consistency and durability than our credit card transaction data, for example.

Re:Why I Migrated Away From MongoDB by taligent on Monday September 17, 2012 @05:37PM (#4535028)
This is complete and utter nonsense.

Facebook and Instagram itself I imagine would care VERY much if data went missing as it would mean not just (a) user data going missing but (b) potentially huge inconsistencies in the social graph.

Unless you have some evidence that those companies do not care about data durability ?

Re:Why I Migrated Away From MongoDB by nerd_in_rage on Monday September 17, 2012 @08:25PM (#4535615)
What? It's the absolute truth. If someone's wall post or tweet goes missing, it's totally inconsequential.

"Social graph" - LOL.

Re:Why I Migrated Away From MongoDB by lttlrck on Monday September 17, 2012 @10:49PM (#4536034)
You think FB doesn't consider durability and consistency essential? With almost one billion users?!

Wow.

Whether it is consequential or not is completely beside the point. As is whether you understand the "social graph".

Re:Why I Migrated Away From MongoDB by nerd_in_rage on Monday September 17, 2012 @11:27PM (#4536146)
Eventual consistency, yes. What I'm saying is if a few pics disappear for a half hour while things resolve themselves, nobody is going to care... or likely notice.

It's not a bank.

By the way, I believe social networking is mostly bullshit, which is my "LOL" at the "social graph".

Re:Why I Migrated Away From MongoDB by einhverfr on Monday September 17, 2012 @11:47PM (#4536215)
Eventual consistency however provides no guarantee of consistency unless it is backed by absolute local consistency on every node. Don't you run into CAP theorem problems otherwise?
Re:Why I Migrated Away From MongoDB by taligent on Monday September 17, 2012 @10:44PM (#4536018)
Sure. But if a person or a photo data object goes missing ?

Facebook has different data stores for each of their features so I imagine the loss of a person would be pretty nasty as would a photo data object that multiple people have tagged or commented on.

My point is that when you are the size of Facebook, Twitter etc a loss of data in 0.001% of cases equates to a LOT of data and relationships.

Re:Why I Migrated Away From MongoDB by einhverfr on Monday September 17, 2012 @10:45PM (#4536020)
If it is that important, they'd be using an ACID-compliant solution, right?

You don't use Best-guess Attempt at Sorta-consistent Eventualities for important data ;-)