News for hackers. Stuff that matters.

A comment on How Discord Indexes Billions of Messages Using Elasticsearch. Parent comment

Re:How Discord Indexes Billions of Messages Using Elasticsearch by jazoom on Thursday March 16, 2017 @04:53PM (#13889066)
I suspect you were thinking of changing the number of shards, which can be an important part of rebalancing an index. Unfortunately, Elasticsearch can't do that.
[ Parent | on HN ]
Re:How Discord Indexes Billions of Messages Using Elasticsearch by jonaf on Thursday March 16, 2017 @06:19PM (#13889708)
There is a convenient reindex API available in more recent versions, although in most cases where you can rebuild your index anyway, it's faster to do that.
[ Parent | on HN ]
Re:How Discord Indexes Billions of Messages Using Elasticsearch by jazoom on Thursday March 16, 2017 @06:27PM (#13889753)
Ahh. I was wondering when they were going to get around to implementing that. I might have to upgrade to 5.x soon.
[ Parent | on HN ]
Re:How Discord Indexes Billions of Messages Using Elasticsearch by wsgolfer on Thursday March 16, 2017 @07:34PM (#13890121)
FYI, the reindex API was added as experimental in 2.3, so it's been there for about a year [1]. Even as experimental it worked great.

[1] https://www.elastic.co/guide/en/elasticsearch/reference/2.3/...

[ Parent | on HN ]
Re:How Discord Indexes Billions of Messages Using Elasticsearch by jazoom on Thursday March 16, 2017 @07:41PM (#13890152)
Ha. I just came here to edit my comment. I remember seeing it before and just checked the docs again. In 5.2 it's STILL considered experiential. Craziness. It took me about an hour to build The basic functionality myself.
[ Parent | on HN ]
Re:How Discord Indexes Billions of Messages Using Elasticsearch by jasontedor on Thursday March 16, 2017 @10:10PM (#13890810)
Thank you for noticing this, it is not considered experimental anymore. I integrated a change[1] to update the docs; it should percolate through to the site within thirty minutes.

[1]: https://github.com/elastic/elasticsearch/pull/23621

[ Parent | on HN ]
Re:How Discord Indexes Billions of Messages Using Elasticsearch by jdc0589 on Thursday March 23, 2017 @11:07AM (#13940362)
FYI, the re-index API is awesome.
[ Parent | on HN ]
Re:How Discord Indexes Billions of Messages Using Elasticsearch by jazoom on Thursday March 16, 2017 @11:25PM (#13891174)
Great work. It appears to have already percolated.
[ Parent | on HN ]