Deploying Elasticsearch on a 150 node cluster to index 10B documents

Re:Deploying Elasticsearch on a 150 node cluster to index 10... by craigching on Monday May 23, 2016 @09:16PM (#11758307)

What's your request size and how big are the documents you're needing to parse? Even if you're returning 1000 documents, if you're not fetching the source as part of the request (do you need to?) or if you don't have a ton of fields, it shouldn't be too expensive to parse that to get the total number of hits.

[ Parent | on HN ]

Re:Deploying Elasticsearch on a 150 node cluster to index 10... by jonaf on Monday May 23, 2016 @09:42PM (#11758409)

I'm assuming he needs the source, otherwise he should look at the count API.

[ Parent | on HN ]

Re:Deploying Elasticsearch on a 150 node cluster to index 10... by craigching on Monday May 23, 2016 @10:18PM (#11758563)

The count API just returns counts. I'm assuming he needs some fields to display which should be smaller than source if source is "large." Unfortunately we are left to guess at his statements because not enough detail is provided.

[ Parent | on HN ]