News for hackers. Stuff that matters.
Re:Elasticsearch 6.0.0 GA released by naiv on Tuesday November 14, 2017 @04:20PM (#15699237)
Cross data center replication is really a much needed feature.

The way Elasticsearch is going though looks promising. With sorted indices, single mapping type and the other changes we might give it another try after switching to Algolia.

Is there a safe way now to query Elasticsearch directly without the need to go via proxy scripts on the server? This just adds so much overhead to the queries compared to Algolia.

Re:Elasticsearch 6.0.0 GA released by jasontedor on Tuesday November 14, 2017 @05:16PM (#15699709)
Jason from Elastic here. We are actively developing cross datacenter replication (internally we are calling it "cross cluster replication" so you will likely see it referred to this in the future but of course this is subject to change).

I can not give a timeframe, but it is one of the top features on the ES roadmap. :)

Source: I am an engineer working on this feature.

Re:Elasticsearch 6.0.0 GA released by bullen on Tuesday November 14, 2017 @08:00PM (#15700709)
Maybe you could be inspired by my async-to-async database: https://github.com/tinspin/rupy/wiki/Storage
Re:Elasticsearch 6.0.0 GA released by gibrown on Tuesday November 14, 2017 @05:29PM (#15699808)
> Cross data center replication is really a much needed feature.

This works pretty well already if you are running on your own hardware and have a good network. We've been running a three data center setup across the US for four years. Next year we may extend it across the Atlantic.

https://greg.blog/2014/01/09/scaling-elasticsearch-part-1-ov...

Re:Elasticsearch 6.0.0 GA released by nemo44x on Tuesday November 14, 2017 @04:24PM (#15699270)
You have always been able to use the query DSL to write queries, aggregations, etc. If you're referring to scripting then yes, in 5.0 the "Painless" scripting language was introduced which allows you to send scripted queries via API request without having to store them on the server. The language was designed to not allow for exploits like when using other languages for running scripts on Elasticsearch.
Re:Elasticsearch 6.0.0 GA released by naiv on Tuesday November 14, 2017 @04:29PM (#15699318)
I meant querying the index from the frontend directly.
Re:Elasticsearch 6.0.0 GA released by nemo44x on Tuesday November 14, 2017 @04:34PM (#15699361)
As in a publicly facing front end? If that's your case, you wouldn't ever want to expose Elasticsearch to your front end directly. If you have a private front end that is inside your firewall then just create HTTP requests to Elasticsearch - it has a RESTful API.

But querying from a publicly facing front end would be a poor idea - would you expose a database directly to the front end?

Re:Elasticsearch 6.0.0 GA released by naiv on Tuesday November 14, 2017 @04:49PM (#15699505)
It is called Elasticsearch and not Elasticdatabase, at one point it sounded like good idea to jump on the nosql bandwagon.

It is a fantastic idea to call the index directly from the frontend and could be solved with a read only type of index or api key with read only scope.

The current design with an unnecessary security layer outside of Elasticsearch is a poor idea adding too much administrative overhead and ridiculous latency.

Re:Elasticsearch 6.0.0 GA released by loopdoend on Tuesday November 14, 2017 @08:13PM (#15700768)
They have what you are looking for with their X-Pack Security addition, which requires a license, though under very favourable terms compared to others...
Re:Elasticsearch 6.0.0 GA released by notyourwork on Tuesday November 14, 2017 @08:54PM (#15700908)
Hamburgers also don't have ham, you are missing the point.
Re:Elasticsearch 6.0.0 GA released by spencera on Wednesday November 15, 2017 @01:29AM (#15701841)
I suggest checking out cloud.elastic.co if you want a way to securely query Elasticsearch directly from the browser without getting X-Pack