News for hackers. Stuff that matters.
Re:Wouldn't it be fun to build your own Google? by arthurcolle on Wednesday December 10, 2014 @02:44PM (#8731235)
I'm pretty sure Elastic is on the right direction in this regard, don't you think?
Re:Wouldn't it be fun to build your own Google? by nemothekid on Wednesday December 10, 2014 @03:34PM (#8731515)
I think "full-text indexing" is a very different problem than "search."

Full-text indexing (what ES provides) has been around for almost forever, ES just does a way better job of productizing/delivering it.

However, Google is far more than a text index. Ranking, currently is still very difficult and requires messing around with facet and weighting parameters.

Re:Wouldn't it be fun to build your own Google? by andrewhillman on Wednesday December 10, 2014 @03:15PM (#8731405)
I don't think so. I just went to their site and the first case study i opened was from theguardian.com. I went to theguardian.com and went to do a search. Guess who they are using to power their search function? Google.

In my opinion which means nothing, sites need to figure out how to power their own search. Using a third party isn't going to work for most. Maybe people need to focus on building custom architecture that indexes the data in a more structured way rather than cobbling systems together that ultimately hinder search efforts when its time to get the user what they want. I don't know the answer but somebody eventually will. Maybe wordpress will create a powerful search for all those wordpress sites.

Re:Wouldn't it be fun to build your own Google? by arthurcolle on Wednesday December 10, 2014 @04:56PM (#8731969)
Maybe I'm beating a dead horse but I feel like you could create a pretty compelling search engine using ES. I used it this summer at Goldman and it seems like it will really change the landscape... It's just so fast. I mean full-text-indexing seems to be a pretty integral part of search. Maybe it's just the first step, with the second step being a well written ranking function, but that's just my thought.
Re:Wouldn't it be fun to build your own Google? by Igglyboo on Thursday December 11, 2014 @10:58AM (#8735436)
Elastic is more like a quick way to search through huge amounts of text, not a way to rank which hits are more relevant.
Re:Wouldn't it be fun to build your own Google? by arthurcolle on Thursday December 11, 2014 @07:02PM (#8737811)
It lets you define your own ranking /scoring function I think