Web search 30M rows sub-second, cheaply

Re:Web search 30M rows sub-second, cheaply by jgord on Sunday November 22, 2015 @06:47PM (#10612033)

.. I should give a fair and proper comparison to Lucene / Solr / Elasticsearch .. and indeed Sphinx - but haven't used these much.

I guess I assumed the entry-point is a 2 to 4 node cluster ? But this may be my own wrong assumptions.. they may be really ram efficient.

I confess I have a somewhat irrational dislike of what I call big-java .. I really wanted to like Cassandra+Spark for instance, but the install is just such a heavy download of code, I just feel an aversion to installing that.

I have worked with Java, but not recently.. there may be incredibly efficient and small codebases that belie the big-java stereotype.

Iv'e been enjoying the node.js / npm ecosystem myself - but I know smart people who love java-land. We can tolerate each others rants and still share a beer :]

[ Parent | on HN ]

Re:Web search 30M rows sub-second, cheaply by acdha on Sunday November 22, 2015 @07:36PM (#10612194)

ElasticSearch is usually less work to install or manage than the average node app – it completely belies the Java stereotypes.

The Lucene-based search engines are also very well optimized. I'd tend to think of a 30M row dataset as a single machine size unless you need failover or the records are quite large.

[ Parent | on HN ]

Re:Web search 30M rows sub-second, cheaply by Can_Not on Wednesday November 25, 2015 @06:51PM (#10630548)

> ElasticSearch is usually less work to install or manage than the average node app – it completely belies the Java stereotypes.

Wow, that is definitely the opposite of true.

[ Parent | on HN ]