News for hackers. Stuff that matters.
Re:Twitter has lost liability protection in India, governmen... by 6510 on Tuesday July 06, 2021 @05:53AM (#27746149)
how would one even sort search results without bias?
Re:Twitter has lost liability protection in India, governmen... by kumarvvr on Tuesday July 06, 2021 @07:18AM (#27746841)
By removing user profile data as an input to the search query processing and result ranking.
Re:Twitter has lost liability protection in India, governmen... by mlnj on Tuesday July 06, 2021 @07:56AM (#27747198)
That is not the topic being talked about.

Is Google allowed to filter results on any internal criteria they can come up with? It includes all avenues like political, censorship, fake news, low quality, competitor results etc.

Re:Twitter has lost liability protection in India, governmen... by gruez on Tuesday July 06, 2021 @07:39AM (#27747048)
So censoring a specific topic or viewpoint is fine as long as it's applied to everyone?
Re:Twitter has lost liability protection in India, governmen... by kumarvvr on Tuesday July 06, 2021 @12:46PM (#27751018)
Did you even read what I said?

If you remove user related data as an input to the search query, the results will be purely based on algorithm efficiency, rather than feeding on the biases of the users.

Such feedback loops, of showing content that is suitable to the user, will lead to information silos and gradual radicalization of the user.

Re:Twitter has lost liability protection in India, governmen... by 6510 on Friday July 09, 2021 @03:14PM (#27787417)
> the results will be purely based on algorithm efficiency

With much respect for those who have to hammer them out: The algorithms are full of bias, they have to be. They are essentially just a pile of hacks. Machines cant understand articles. Even if they could they would have the same problem a human reviewer would have when asked if article A is better than B. You cant switch off your own bias. Even if we could do all that you may end up with a category dominated by the writings of [say] 50-51 year old Caucasian males which forces you to ponder corrections that may or may not be terrible ideas if or if not applied. And then you have to chose which bias to apply and we are back to biased search results.

People are the sum of their experiences, if you remove that nothing is left.

Re:Twitter has lost liability protection in India, governmen... by wongarsu on Tuesday July 06, 2021 @06:20AM (#27746345)
I think most would call the original pagerank algorithm unbiased. Sure, any algorithm will have a bias towards a certain content length, or towards pages that contain the search terms at a particular density. But by doing that you don't arrive at algorithms that have an opinion on the holocaust or Tiananmen Square [1].

Of course Twitter somehow managed to implement the worst of both worlds, with a sorting algorithm that promotes controversial content (without bias regarding the actual content), but then does biased moderation on that content.

1: https://www.bbc.com/news/world-asia-57367100

Re:Twitter has lost liability protection in India, governmen... by Majromax on Tuesday July 06, 2021 @08:11AM (#27747382)
> I think most would call the original pagerank algorithm unbiased.

I disagree: the point of the original Pagerank algorithm was its bias. In particular, its use of link weights gave the algorithm a strong bias for (a proxy for) relevance.

An "unbiased" search algorithm would need to return results based on simple criteria, readily explained and presented to the searcher, such as "date first crawled" or "number of keyword appearances."

Re:Twitter has lost liability protection in India, governmen... by mlnj on Tuesday July 06, 2021 @09:38AM (#27748341)
You are trivializing every bit of research and advancement gone into improving search engines in the last 20 years.

Please attempt a simple implementation with the methods you describe and see how it performs over even a non trivial amount of data and you will see the difference in results.

And I'm not even considering malicious results gaming the whole system.

Re:Twitter has lost liability protection in India, governmen... by Majromax on Tuesday July 06, 2021 @12:07PM (#27750380)
> You are trivializing every bit of research and advancement gone into improving search engines in the last 20 years.

I disagree. If anything, I think I give this research more credit, because I appreciate it as imposing a normative view on what makes search results "good."

This is more than just "how do we sort a list containing billions of keys" or "how do we grab data from a distributed database;" it's also "how do we understand relevance or quality based on machine-interpretable signals?" The latter is a judgment call.

Re:Twitter has lost liability protection in India, governmen... by AbrahamParangi on Tuesday July 06, 2021 @10:14AM (#27748876)
This is a conflation between the meanings of the word bias as “a weight” and “an ideological stance”. The thing that people take issue with is generally the latter, rather than the former.
Re:Twitter has lost liability protection in India, governmen... by Majromax on Tuesday July 06, 2021 @12:05PM (#27750350)
It is a conflation, but I argue that there's no bright line between the two. The ideology behind pagerank is that relevant results are better and that backlink popularity measures relevance. Another sorting objective is that "more engaging results" are better.

Each is ultimately an expression of will, since there is no objective ranking of what makes something relevant or engaging. Everyone will agree on the order of names in a phone book, but nobody will agree on the "relevance" order of search results.

You see this every day in news-adjacent search topics, where popularity, relevance, and factual correctness can all give different "proper" orderings.

Ultimately, people dislike stances that give disagreeable results, but they think benign stances to be invisible. I don't believe a coherent, legal argument can work this way.

Re:Twitter has lost liability protection in India, governmen... by AbrahamParangi on Tuesday July 06, 2021 @02:02PM (#27752114)
I agree with this line of argument in the sense that a choice of loss function is still a choice with implications that one cannot escape. All choices imply the expression of will and the exercise of power.

I think the essential disagreement isn’t so much about the choice of bias as it is about the exercise of power, specifically on who’s behalf do you exercise power? Do you do it for your users or for the greater good? Or for your customers? Or maybe your investors? Or maybe your ideals?

Re:Twitter has lost liability protection in India, governmen... by Google234 on Tuesday July 06, 2021 @06:44AM (#27746541)
By returning the best match to a search first… second one second…
Re:Twitter has lost liability protection in India, governmen... by Retric on Tuesday July 06, 2021 @06:49AM (#27746583)
Defining best is a biased process. Is cost or quality more important? There is no objective criteria for such judgments it’s all based on personal bias.

So Google favoring low latency responses is saying latency (cost) matters when people browsing may not care.

Re:Twitter has lost liability protection in India, governmen... by danso on Tuesday July 06, 2021 @07:21AM (#27746866)
What makes the best match? Highest number of back links?
Re:Twitter has lost liability protection in India, governmen... by 6510 on Wednesday July 07, 2021 @10:25AM (#27761464)
Ideally you rate the person by his work. (Magnus is a great chess player because we wins games) If we cant rate someones work we can use opinions from those note worthy in their field.

But when those people got their respectable reputation by the same means you could have an entirely circular self-praising reputation machine that seems to work wonderfully but operates without reviewing any work.

At some stage of google the Nr 1 result for both "France" and "Paris" belonged to a blogger from NYC who had a single highly optimized page about France and one about Paris.

Similarly a high page rank page about cars shouldn't be an authority on anything else but if they link to your article about flowers it gains a lot of points. So much it would be attractive to pay them for it.

Back links were fabulous when the internet started then increasingly became a self serving loop.

Re:Twitter has lost liability protection in India, governmen... by argvargc on Tuesday July 06, 2021 @09:59AM (#27748623)
Allow user choice. We all define "bias" differently.