News for hackers. Stuff that matters.
Re:Toshi: An Elasticsearch competitor written in Rust by nathcd on Sunday January 13, 2019 @10:09AM (#18896928)
Neat! I hope this goes far, it'd be great to have a faster/lighterweight Elastcsearch.

Something similar I'm really hoping to see is Tantivy in a Postgres extension, so I can stop playing the game of trying to keep my search engine and database in sync. Seeing pg-extend-rs (https://github.com/bluejekyll/pg-extend-rs) on HN the other week got me thinking about it again. Does anyone know whether this is feasible or if anyone is working on something in this vein?

Re:Toshi: An Elasticsearch competitor written in Rust by profquail on Sunday January 13, 2019 @10:59AM (#18897130)
Out of curiosity —- have you looked at using Postgresql’s full text search functionality to implement your search engine (e.g. [1])? If so, what do you get out of the combination of Postgres + Elasticsearch that you chose it over just the Postgres full text search?

[1] http://rachbelaid.com/postgres-full-text-search-is-good-enou...

Re:Toshi: An Elasticsearch competitor written in Rust by Ralfp on Sunday January 13, 2019 @01:36PM (#18897968)
Major problem with Postgres full-text search that those articles don't dwell into too much is that unless your documents are in one of the "chosen languages", you are more likely to find support for your language in search engine (like ElasticSearch) than get it on PostgreSQL.

You can convert existing dictionaries available to format Postgres understand, but this is annoying pain point if you happen to be an open source project like CMS or communication platform.

Re:Toshi: An Elasticsearch competitor written in Rust by hashhar on Sunday January 13, 2019 @02:00PM (#18898083)
I don't get the hype about elasticsearch at all. Elasticsearch is more suited to searching logs. It doesn't have powerful sort functions, doesn't allow you to use multiple sort parameters etc.

Apache Solr is more suited to search. Lots of document filters, query filters, the index itself is highly configurable and the ability to sort on multiple parameters is great. LTR is also something too good to miss out on.

Re:Toshi: An Elasticsearch competitor written in Rust by k9s9 on Sunday January 13, 2019 @03:28PM (#18898495)
The difference is in the size of your Sales team.

Lot of open source projects would benefit, if they had dedicated sales teams contacting firms day in, day out talking about their features.

People who run IT departments in the Enterprise world or even small firms lacking resources to keep up, just pick tools and make software decisions based on who reaches out to them.

Invest in a sales team and you penetrate markets that don't spend time monitoring developments in the tech world which is really the majority of all orgs. Elastic has done that quite well and is reaping the rewards.

Re:Toshi: An Elasticsearch competitor written in Rust by jillesvangurp on Sunday January 13, 2019 @06:12PM (#18899339)
Nonsense, Elasticsearch does all these things (and extremely well too). These are core lucene features. I'm not aware of any much that Solr does that Elasticsearch does not. And yes, I've used both.

Solr was there earlier. In many ways, Elasticsearch was a response to stuff Solr did not do, or did not do well. Like clustering for example. Solr has of course added this since then.

Re:Toshi: An Elasticsearch competitor written in Rust by rpedela on Sunday January 13, 2019 @02:22PM (#18898198)
Can you explain what you mean by "multiple sort parameters" because it looks like you can to me in ES [1]. There is a well maintained LTR plugin for ES. Honestly Solr and ES are more similar than different. There are a few things Solr has which ES doesn't and the reverse is true too.

1. https://www.elastic.co/guide/en/elasticsearch/reference/curr...

Re:Toshi: An Elasticsearch competitor written in Rust by hashhar on Sunday January 13, 2019 @04:07PM (#18898682)
Thanks for letting me know about Elasticsearch LTR.
Re:Toshi: An Elasticsearch competitor written in Rust by bryanrasmussen on Sunday January 13, 2019 @03:25PM (#18898478)
Both solr and elasticsearch use lucene to index.
Re:Toshi: An Elasticsearch competitor written in Rust by hashhar on Sunday January 13, 2019 @04:07PM (#18898689)
ES doesn't expose as many knobs last I checked.
Re:Toshi: An Elasticsearch competitor written in Rust by burntsushi on Sunday January 13, 2019 @03:51PM (#18898599)
Last time I checked, PostgreSQL doesn't support any kind of tfidf ranking scheme because it doesn't track corpus frequencies of terms in the index. This impacts how well relevance ranking works for some workloads.
Re:Toshi: An Elasticsearch competitor written in Rust by lykr0n on Sunday January 13, 2019 @11:06AM (#18897167)
ZoomDB (https://github.com/zombodb/zombodb) offers something like this.
Re:Toshi: An Elasticsearch competitor written in Rust by 33degrees on Sunday January 13, 2019 @01:03PM (#18897799)
Didn’t know about this project, very cool.
Re:Toshi: An Elasticsearch competitor written in Rust by zombodb on Wednesday January 16, 2019 @09:20PM (#18927732)
Thanks! It’s been fun to develop it and we love when people discover and use it
Re:Toshi: An Elasticsearch competitor written in Rust by aldoushuxley001 on Sunday January 13, 2019 @10:31AM (#18897012)
I know you can go pretty far just within postgresql these days without any extensions, even for production grade search.

For my projects thats all I've been doing, in order to avoid the overhead of ensuring ES or Solr are synced with db.

Re:Toshi: An Elasticsearch competitor written in Rust by GordonS on Sunday January 13, 2019 @12:39PM (#18897655)
Just released a system that does the same - Postgres FTS can get you a long way. I've used Elasticsearch before, and it's a lot of complexity to add, and isn't always necessary.
Re:Toshi: An Elasticsearch competitor written in Rust by FridgeSeal on Sunday January 13, 2019 @04:00PM (#18898657)
There’s a super neat plugin for Postgres called “ZomboDB” that hooks up ElasticSearch to Postgres, so when you make full text queries, it gets performed on ES. https://www.zombodb.com/

I had a brief play with it for a project at work and it was super straightforward to get running.

Re:Toshi: An Elasticsearch competitor written in Rust by jedisct1 on Monday January 14, 2019 @08:21AM (#18902709)