News for hackers. Stuff that matters.
Re:Why MongoDB is a bad choice for storing our scraped data by lmm on Tuesday May 14, 2013 @10:47AM (#5705182)
"plain old SQL" can require a lot of mangling one's data to fit its constraints. I refuse to believe that there isn't a better key-value store for the case where the values are json documents, even if mongodb isn't it.
Re:Why MongoDB is a bad choice for storing our scraped data by gaius on Tuesday May 14, 2013 @11:04AM (#5705330)
Except it isn't "SQL" it's first-order predicate calculus - a provably sound way to store and query your data.
Re:Why MongoDB is a bad choice for storing our scraped data by pwg on Tuesday May 14, 2013 @11:20AM (#5705460)
But if one is going to use a key-value store anyway, where is the "mangling"? Building a key-value store in an SQL database is trivial (this below is for PostgreSQL):

    create table keyvalue (key text, value text);
    create index keyvalue_idx on keyvalue(key);
And use is trivial as well:

    insert into keyvalue (key, value) values ('key', 'value');

    select value from keyvalue where key = 'key';
[edit] formatting fix.
Re:Why MongoDB is a bad choice for storing our scraped data by lmm on Tuesday May 14, 2013 @11:28AM (#5705527)
It is not nice to have to manipulate JSON as a plain string (you miss out on validation, have to manually construct like expressions for queries, and I don't even want to think about what you'd have to do to update part of a document), at least using "plain old SQL". (PostgreSQL's native JSON support would make it quite easy, but that supports my point)
Re:Why MongoDB is a bad choice for storing our scraped data by snaky on Tuesday May 14, 2013 @12:28PM (#5705990)
If you need to query JSON content, why to store it like plain string, to begin with? Parse it at application level (or even in stored procedure) and store like ordinary fields. Or use hstore.
Re:Why MongoDB is a bad choice for storing our scraped data by kanja on Tuesday May 14, 2013 @02:58PM (#5707201)
Postgres additionally has a json field type.
Re:Why MongoDB is a bad choice for storing our scraped data by snaky on Tuesday May 14, 2013 @05:08PM (#5708171)
That is for now, until PostgreSQL 9.3 released, have only one useful feature comparing to plain string - validation. That's not much help, and that original lmm's point was about.
Re:Why MongoDB is a bad choice for storing our scraped data by JulianMorrison on Tuesday May 14, 2013 @12:52PM (#5706169)
Redis. Riak. Rethinkdb. Cassandra (with a mapping layer). SQL (with a mapping layer). SQL, in a JSON-typed column (PostgreSQL supports it). SQL, in a blob field, plus indexes. I could go on.