Re:Amazon's search is pretty darn impressive
by thorax on Friday December 12, 2008 @12:01PM
(#395818)
Much better than Amazon used to have, definitely.
Though I'm not so sure it's really as impressive as I first thought. It seems to heavily weigh the beginning of the search text. Here's the same search you used, but with the beginning part moved to the end:
We do a lot of this full-text search optimization at bug.gd-- we focus on parts of the text that are the rarest in the corpus/index and provide a higher weight to matches on those keywords (also factoring in phrase/proximity).
I thought Amazon was doing something similar, but the change in moving around the words either means they have a maximum number of keywords they actually pass to their engine, or they're using a bias towards words at the front of the search (which is interesting itself).
Re:Amazon's search is pretty darn impressive
by brandnewlow on Friday December 12, 2008 @03:05AM
(#395492)
My implicit point, exactly.
I'm working on a memetracker system that will pull in related data on the fly to spruce up the memes. Google proper's been all but useless to me. Youtube's search api has actually been a great last-resort way to get related images. Meanwhile Amazon looks like a pretty good tool too.
Re:Amazon's search is pretty darn impressive
by aston on Friday December 12, 2008 @04:49AM
(#395546)
I'm thinking it might start with their algorithm for finding improbable phrases. They serve as a kind of a word-based fingerprint for a book and probably make searching on over-specific queries like this one a lot easier.
Re:Amazon's search is pretty darn impressive
by zeke on Friday December 12, 2008 @11:45AM
(#395799)
Not too long ago Amazon did not return anything if one word was wrong. They had "The Chocolate Bible : The Difinitive Sourcebook" and would not find it in a search with "definitive" spelled correctly. They have a better search now.
Re:Amazon's search is pretty darn impressive
by dangoldin on Friday December 12, 2008 @10:10AM
(#395687)
Well my guess would be that they have a structured data back end of titles, authors, and so forth. They can then look at the query string and extract everything that looks like a proper noun (or doesn't exist in a dictionary) and and compare that against their structured data database.
I'm sure it's more advanced than that but that would get you pretty far.
Though I'm not so sure it's really as impressive as I first thought. It seems to heavily weigh the beginning of the search text. Here's the same search you used, but with the beginning part moved to the end:
http://ri.ms/vl7
We do a lot of this full-text search optimization at bug.gd-- we focus on parts of the text that are the rarest in the corpus/index and provide a higher weight to matches on those keywords (also factoring in phrase/proximity).
I thought Amazon was doing something similar, but the change in moving around the words either means they have a maximum number of keywords they actually pass to their engine, or they're using a bias towards words at the front of the search (which is interesting itself).
http://www.google.com/search?hl=en&q=%22The+Triumph+of+R...
I'm working on a memetracker system that will pull in related data on the fly to spruce up the memes. Google proper's been all but useless to me. Youtube's search api has actually been a great last-resort way to get related images. Meanwhile Amazon looks like a pretty good tool too.
http://www.google.com/search?hl=en&q=The+Triumph+of+Robe...
That's not a very Googley thing to do...
http://www.amazon.com/gp/search-inside/sipshelp.html
I'm sure it's more advanced than that but that would get you pretty far.