Yandex ‘leak’ reveals 1,922 search ranking factors

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by michaelmior on Monday January 30, 2023 @07:54AM (#34578991)

This is assuming the weights are combined via some linear function. That's not necessarily the case. It's likely that the ranking algorithm is more complex than: calculate features, multiply by weights, add to get ranking. Sure you'll probably still be able to learn something more by playing with the different features, but I doubt you'll get any real meaningful "weights." Especially when how many features are calculated is a black box.

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by h0l0cube on Monday January 30, 2023 @08:15AM (#34579167)

Why would it be more complicated? A simple dot product would have excellent scaling characteristics

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by toto444 on Monday January 30, 2023 @08:22AM (#34579234)

When it comes to ML scalability is a constraint not a goal. The goal is to minimize some loss function and it turns out simple dot product can be outperformed by more complex algorithms.

I remember reading a few years ago that most search engines use some tree based model. If that's the case, that means the idea of monotonic linear weights is not relevant.

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by h0l0cube on Monday January 30, 2023 @09:13AM (#34579801)

Can you be more specific? Dot product is about as performant as it gets with linear memory access and SIMD multiply accumulate. Throw random memory access and flow control in there and it’s a struggle to do it faster. Unless the factors are sparse, in which case just elide the zero values.

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by ethbr0 on Monday January 30, 2023 @09:44AM (#34580166)

> scalability is a constraint not a goal. The goal is to minimize some loss function

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by h0l0cube on Monday January 30, 2023 @09:59AM (#34580391)

My bad. I was under the impression that most search engines are compute bound, but if anything there’s probably a glut of compute for such applications and a market appetite for better results.

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by ethbr0 on Monday January 30, 2023 @11:35AM (#34582191)

Also, I'd assume it's highly time-agnostic (i.e. content change timespan : compute availability timespan).

So you can run your bulk-recomputing whenever you have spare capacity.

Stale rankings aren't great, but don't hurt that much. As long as your liveness is more frequently updated, so you don't send people to dead sites.

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by h0l0cube on Monday January 30, 2023 @06:26PM (#34588199)

Certainly caching is important, especially for Word2Vec or other NLP which you'd want to happen in a separate stage after crawl, but as someone mentioned in a sibling comment, there are some factors that are calculated per-query, which can have a lot of cache misses for novel queries.

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by ethbr0 on Monday January 30, 2023 @09:06PM (#34589957)

If so, I'd highly suspect Google varies the compute/cache permitted for novel queries.

By this point, I can't imagine they haven't automatically balanced {revenueFromQuery} to {costOfQuery}.

No sense delivering hyperoptimized results if you lose money on generating them.

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by h0l0cube on Monday January 30, 2023 @10:08PM (#34590356)

I’d suspect you’re right

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by CWuestefeld on Monday January 30, 2023 @09:17AM (#34579848)

I designed the ranking algorithm for our product search. There are several factors in it that are nonlinear.

For example, we obviously want the most-viewed and most-bought products to rise to the top. However, we also expect there's an initial honeymoon period for many new products, where people want to see them but they don't have enough history yet to sway the popularity factor. So there's a non-linear term that looks kind of like

  ( weight_factor / (product_age_days * age_scale_constant) )

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by h0l0cube on Monday January 30, 2023 @09:53AM (#34580285)

At a glance it seems like there works be a way to form the weighting adjustment into a subquery and multiply by the reciprocal. And then it’s still multiply-accumulate, but maybe I’m missing something.

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by CWuestefeld on Monday January 30, 2023 @04:48PM (#34586916)

Isn't that just saying "delegate the nonlinear part out to a black box"?

[ Parent | on HN ]

Re:Yandex ‘leak’ reveals 1,922 search ranking factors by h0l0cube on Monday January 30, 2023 @06:39PM (#34588353)

At a glance (1 / (product_age_days * age_scale_constant)) just seems like another factor you can multiply (with the calculation of reciprocal costing more in compute time). Again, I'm more than likely misunderstanding you or lacking the context.

[ Parent | on HN ]