> I'd love to see a MongoDB component that replicates data from the oplog to a dedicated full-text store like Lucene or Solr.
Photovoltaic does this: https://github.com/mikejs/photovoltaic
I haven't had time to play arround with it yet though :(
Re:Full Text Search in Mongo
by rabidsnail on Sunday March 27, 2011 @08:54PM
(#2376614)
How are you doing your tokenization and stemming? I find it hard to believe that the actual token lookup is slower.
Re:Full Text Search in Mongo
by ChrisFulstow on Sunday March 27, 2011 @09:12PM
(#2376659)
Tokenization was a simple string split on whitespace, and no stemming. It was quite a large Mongo dataset, so only a fraction of the index and data would've been in memory, it could've easily been quicker for a smaller dataset living in memory. For me, one of the benefits of Lucene is the powerful built-in query parsing, tokenization, analyzers, etc.
Re:Full Text Search in Mongo
by rabidsnail on Sunday March 27, 2011 @11:21PM
(#2376993)
The performance probably would have been better if the dataset (or at least the portion of the dataset that gets touched frequently) was smaller. But why wouldn't lookup in lucene be at least as slow?
I'd love to see a MongoDB component that replicates data from the oplog to a dedicated full-text store like Lucene or Solr.