News for hackers. Stuff that matters.
Re:What Powers Instagram: Hundreds of Instances, Dozens of T... by rbranson on Tuesday July 10, 2012 @06:11PM (#4226517)
The reason we use Solr for this specific task is because PostgreSQL cannot efficiently and quickly merge two index queries (time & space). It can do this to a limited degree, but both of these dimensions potentially match 10s of millions of documents, and PG falls over at this.
Re:What Powers Instagram: Hundreds of Instances, Dozens of T... by timaelliott on Tuesday July 10, 2012 @06:19PM (#4226551)
So you make the r-tree 3 dimensions (lat,lng,time). PostgreSQL supports this.

I dunno I can't envision Solr being more efficient than a properly designed RDBMS for these situations. If you were integrating a full-text search I'd absolutely believe that to be the case but...

Re:What Powers Instagram: Hundreds of Instances, Dozens of T... by rbranson on Tuesday July 10, 2012 @06:45PM (#4226660)
We need independent time & geo searches as well. The indexes are vastly smaller in Solr. We use PostgreSQL extensively and prefer it, so it's not a matter of simply wanting to use something different.
Re:What Powers Instagram: Hundreds of Instances, Dozens of T... by fdr on Wednesday July 11, 2012 @01:13AM (#4227826)
That's very interesting. Could you share your story with the mailing list pgsql-hackers a little bit? The guys who work on indexing are quite active on those lists.

Also, there's some new thing I don't understand super well, sp-gist, do you have any thoughts on that?