News for hackers. Stuff that matters.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by paulsutter on Saturday April 18, 2015 @01:36PM (#9400264)
It's convenient to think our work is so sophisticated, and that lawmakers are simpletons. But that's a naive view.

They want the algorithm disclosed as a legal matter to determine whether competitors are disadvantaged. Which probably means they are more interested in email than source code. There exist hyperintelligent lawyers. Yes, smart enough to understand search. A law firm like Keker and Van Nest [1] could go in there and answer the question. France could be willing to spend a billion to find out, and that's more than they need.

Legislation of technology is frightening to any technologist. But it's much more dangerous if we dismiss the process as ridiculous and refuse to recognize any underlying concerns. Because then technologists won't have any say in the outcome.

[1] http://www.kvn.com/

EDIT: Paul you're such a prominent guy, I don't mean to speak too strongly, but people really listen to what you say. Entrepreneurs ought to know that legal matters are not so easily dismissed. I do hope, generously speaking, the startups are the ones that call KVN and not the legislators.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by x0x0 on Saturday April 18, 2015 @02:51PM (#9400577)
Google has (very effectively) played the "oh noes, it's all machine learning" card. But machine learning is nothing more than codified human judgement (yes, I get that for example the conditional expectation minimizes the expected squared error, but who picked the expected squared error to minimize?) The point is, they wish the ranking algorithm to be seen as some divine choice and hence not subject to criticism rather than a mathematical extension of human choices.

So has google put a finger on the scale to rank google properties more highly? Based on their behavior with the results page (vs yelp, for example), I would be surprised if they do, but not very surprised.

Nonetheless, now that google search results are the internet for many people -- and chrome's address bar is used to help blur that distinction -- it's fair that people outside google, represented by governments, start having a say in who shows up and where. That's what happens when you're a monopoly.

It is slightly ironic that bing is the best thing that's happened to google in a decade. Where it not for Balmer deciding to play search engine, google would be known to be a 95+% monopoly in the US as well. Bing allows them to pretend they aren't (though on my blog, for example, 99.28% of ~7k search referral visitors comes from google.)

Re:French Senate Backs Bid To Force Google To Disclose Searc... by cromwellian on Saturday April 18, 2015 @03:18PM (#9400675)
The fallacy is, there's mostly likely no one single 'algorithm' anymore. There are most likely hundreds, farmed out in a distributed manner, with the final SERP page coming from merging many different rankings together.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by x0x0 on Saturday April 18, 2015 @03:37PM (#9400728)
That doesn't matter. At the end of the day, for each query, there is produced a single ranking.

Given access to the data, or more ideally the ability to rapidly batch query, one could ask does being a google owned or rev-share site affect rankings? And if so, up or down? These are the questions statistics is made to answer.

edit -- and it doesn't even necessarily need be hardwired. For example, google could have more visibility into site interactions on google owned or tooled (GA) sites, and that could tend to lead to lower serps. Ie just the presence of certain features, only available to google when google owns or tools a site, could tend to produce lower ratings no matter what those features are. This is, I would argue, dirty pool for what is effectively a monopoly. And statistics can answer these questions.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by minot on Saturday April 18, 2015 @04:41PM (#9400933)
Imagine if latency was one of the signals Google used to determine ranking. Now imagine that Googlebot gets a ping of half for an application that uses Google App Engine as opposed to someone who uses a raspberry pie at home. Would you say that the makers and users of Raspberry pie now have grounds to sue Google for ranking them lower?
Re:French Senate Backs Bid To Force Google To Disclose Searc... by walterbell on Saturday April 18, 2015 @05:18PM (#9401089)
What about geographic latency? Could user or regional preferences be an input into ranking?
Re:French Senate Backs Bid To Force Google To Disclose Searc... by x0x0 on Saturday April 18, 2015 @06:32PM (#9401349)
Because lots of the internet is being served off raspberry pis located in peoples' living rooms? Don't be deliberately obtuse.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by jfoster on Sunday April 19, 2015 @03:17AM (#9402309)
Raspberry Pi was a poor example for him to use, but App Engine (or any Google Cloud solution) was a good example. The Google-hosted sites (including the properties Google owns & operates) will always seem to have lower latency to Google versus everything from AWS down to a Raspberry Pi in a basement. Should that be considered an unfair impartiality in Google's algorithm?
Re:French Senate Backs Bid To Force Google To Disclose Searc... by x0x0 on Sunday April 19, 2015 @03:34AM (#9402342)
Lower latency to google should have no bearing on serps.

Lower latency to the user should. If, ceteris paribus, google sites are lower ranked then yes, that should be illegal. ie consider regression and compute I[google] + site_speed; after controlling for site speed, being a google owned property shouldn't matter. It's fine if google owned sites tend to be faster and hence are more lowly ranked.

I specifically meant more along the lines of google can view your navigation through GA tooled sites, and there is a wealth of information that can be derived from that.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by curun1r on Saturday April 18, 2015 @04:01PM (#9400802)
Moreover, even if you concede that there's a single algorithm at one point in time, there's still not a single algorithm since the Google search result you get today will be the result of a different algorithm than the one that determined the result of the same query last week. It's not only necessary for the French government to ask how the algorithm works, but they'll need a daily changelog or the algorithm description will become stale quite quickly.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by stretchwithme on Saturday April 18, 2015 @04:00PM (#9400799)
One camp creates machines that actually work and coerce no one to do business with them.

The other has to use force. That's all they know how to use. Its their solution to every problem.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by mercurial on Saturday April 18, 2015 @04:34PM (#9400905)
> It's convenient to think our work is so sophisticated, and that lawmakers are simpletons. But that's a naive view.

I don't think anybody is suggesting they are simpletons. Unfortunately, French lawmakers are fairly tech-illiterate on average (as demonstrated by the recent vote for the mass surveillance law).

That said, I kind of agree with you. Investigating Google is one thing, asking for them to spill their trade secrets is another.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by tomjen3 on Sunday April 19, 2015 @05:04AM (#9402489)
Technologists don't win by fighting in the legal system - the others have centuries of advantages here. If the others call KVN then they need to know that if they answer they better hope they have never used Facebook and that their daughters haven't shared any photos on snap-chat.

What we need is not to be involved in matters of law, but to have a mutual defence treaty that will ensure the law doesn't get to steal and redistribute what we make. France needs Google, but to Google France is just one customer - and they should treat them accordingly.