News for hackers. Stuff that matters.
Re:Google search results have more human help than you think... by tyingq on Monday November 18, 2019 @10:49AM (#21565210)
Not immoral or illegal, but using human raters to seed an algorithm can make the results worse. For example, it could skew to favoring websites where the rater is familiar with the brand. Which might rank mediocre branded content over less well known sites with much higher quality content.

That seems to match what I've seen over the last 10 years with Google.

Re:Google search results have more human help than you think... by cinnamonheart on Monday November 18, 2019 @12:13PM (#21566034)
I worked for Leapforce for a while doing this sort of rating work using Google's guidelines. The guidelines were linked elsewhere in this thread and, at a glance, they are the same ones I used:

https://static.googleusercontent.com/media/guidelines.raterh...

If you're doing something that would skew the results to favour a certain brand, you'd be going against Google's guidelines and your contract would be terminated quickly. I found the review process of my results to be fairly stringent; they were reviewed frequently to ensure I was staying within the guidelines, and I was told even about slight deviatiations.

Re:Google search results have more human help than you think... by tyingq on Monday November 18, 2019 @01:37PM (#21566853)
I'm not suggesting it would be on purpose. Trust must have some subconscious effect.
Re:Google search results have more human help than you think... by shadowgovt on Monday November 18, 2019 @10:56AM (#21565286)
Can you give some examples of higher-quality-content sites that Google search is consistently missing?
Re:Google search results have more human help than you think... by rahidz on Monday November 18, 2019 @03:35PM (#21567902)
Examine.com is one, here's the prior HN thread. Had it not been for that HN thread I would never have known that site even existed, despite having frequently searched for queries where it would have been extremely relevant: https://news.ycombinator.com/item?id=20676755
Re:Google search results have more human help than you think... by shadowgovt on Monday November 18, 2019 @04:04PM (#21568126)
examine.com is the first organic search result I get for "supplemental vitamin d sleep". Maybe the results are hit-or-miss depending on the subtopic (or Google re-tuned the algorithm in the intervening 3 months).
Re:Google search results have more human help than you think... by magicalist on Monday November 18, 2019 @01:37PM (#21566852)
> Not immoral or illegal, but using human raters to seed an algorithm can make the results worse

...versus asking an oracle what the "good" results are? It's not clear what you'd propose as an alternative.

Re:Google search results have more human help than you think... by tyingq on Monday November 18, 2019 @02:31PM (#21567366)
Mitigating controls, expecting the bias.

At the moment it's a Frankenstein set up with a rules/algorithm based ranking subsequently shuffled around by several separate ML runs with different aims.

The FTC did once unearth a Google attempt to purposefully influence the human ratings: http://graphics.wsj.com/google-ftc-report/ (long read, but worth it). Find this section of the paper:

"Unable to get positive reviews from raters when Google demoted comparison shopping sites, Google changed the raters' criteria to try to get positive results."