News for hackers. Stuff that matters.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by paul on Saturday April 18, 2015 @11:28AM (#9399750)
They have no concept of how complex ranking is. There are millions of factors being fed into massive machine learning systems that try to predict which results users want (which is different from which they are most likely to click). It's like asking to see the algorithm for a cat.

They should go back to working on their own "Google killer" search engine :) http://www.infoworld.com/article/2672709/operating-systems/e...

Re:French Senate Backs Bid To Force Google To Disclose Searc... by paulsutter on Saturday April 18, 2015 @01:36PM (#9400264)
It's convenient to think our work is so sophisticated, and that lawmakers are simpletons. But that's a naive view.

They want the algorithm disclosed as a legal matter to determine whether competitors are disadvantaged. Which probably means they are more interested in email than source code. There exist hyperintelligent lawyers. Yes, smart enough to understand search. A law firm like Keker and Van Nest [1] could go in there and answer the question. France could be willing to spend a billion to find out, and that's more than they need.

Legislation of technology is frightening to any technologist. But it's much more dangerous if we dismiss the process as ridiculous and refuse to recognize any underlying concerns. Because then technologists won't have any say in the outcome.

[1] http://www.kvn.com/

EDIT: Paul you're such a prominent guy, I don't mean to speak too strongly, but people really listen to what you say. Entrepreneurs ought to know that legal matters are not so easily dismissed. I do hope, generously speaking, the startups are the ones that call KVN and not the legislators.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by x0x0 on Saturday April 18, 2015 @02:51PM (#9400577)
Google has (very effectively) played the "oh noes, it's all machine learning" card. But machine learning is nothing more than codified human judgement (yes, I get that for example the conditional expectation minimizes the expected squared error, but who picked the expected squared error to minimize?) The point is, they wish the ranking algorithm to be seen as some divine choice and hence not subject to criticism rather than a mathematical extension of human choices.

So has google put a finger on the scale to rank google properties more highly? Based on their behavior with the results page (vs yelp, for example), I would be surprised if they do, but not very surprised.

Nonetheless, now that google search results are the internet for many people -- and chrome's address bar is used to help blur that distinction -- it's fair that people outside google, represented by governments, start having a say in who shows up and where. That's what happens when you're a monopoly.

It is slightly ironic that bing is the best thing that's happened to google in a decade. Where it not for Balmer deciding to play search engine, google would be known to be a 95+% monopoly in the US as well. Bing allows them to pretend they aren't (though on my blog, for example, 99.28% of ~7k search referral visitors comes from google.)

Re:French Senate Backs Bid To Force Google To Disclose Searc... by cromwellian on Saturday April 18, 2015 @03:18PM (#9400675)
The fallacy is, there's mostly likely no one single 'algorithm' anymore. There are most likely hundreds, farmed out in a distributed manner, with the final SERP page coming from merging many different rankings together.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by x0x0 on Saturday April 18, 2015 @03:37PM (#9400728)
That doesn't matter. At the end of the day, for each query, there is produced a single ranking.

Given access to the data, or more ideally the ability to rapidly batch query, one could ask does being a google owned or rev-share site affect rankings? And if so, up or down? These are the questions statistics is made to answer.

edit -- and it doesn't even necessarily need be hardwired. For example, google could have more visibility into site interactions on google owned or tooled (GA) sites, and that could tend to lead to lower serps. Ie just the presence of certain features, only available to google when google owns or tools a site, could tend to produce lower ratings no matter what those features are. This is, I would argue, dirty pool for what is effectively a monopoly. And statistics can answer these questions.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by minot on Saturday April 18, 2015 @04:41PM (#9400933)
Imagine if latency was one of the signals Google used to determine ranking. Now imagine that Googlebot gets a ping of half for an application that uses Google App Engine as opposed to someone who uses a raspberry pie at home. Would you say that the makers and users of Raspberry pie now have grounds to sue Google for ranking them lower?
Re:French Senate Backs Bid To Force Google To Disclose Searc... by walterbell on Saturday April 18, 2015 @05:18PM (#9401089)
What about geographic latency? Could user or regional preferences be an input into ranking?
Re:French Senate Backs Bid To Force Google To Disclose Searc... by x0x0 on Saturday April 18, 2015 @06:32PM (#9401349)
Because lots of the internet is being served off raspberry pis located in peoples' living rooms? Don't be deliberately obtuse.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by jfoster on Sunday April 19, 2015 @03:17AM (#9402309)
Raspberry Pi was a poor example for him to use, but App Engine (or any Google Cloud solution) was a good example. The Google-hosted sites (including the properties Google owns & operates) will always seem to have lower latency to Google versus everything from AWS down to a Raspberry Pi in a basement. Should that be considered an unfair impartiality in Google's algorithm?
Re:French Senate Backs Bid To Force Google To Disclose Searc... by x0x0 on Sunday April 19, 2015 @03:34AM (#9402342)
Lower latency to google should have no bearing on serps.

Lower latency to the user should. If, ceteris paribus, google sites are lower ranked then yes, that should be illegal. ie consider regression and compute I[google] + site_speed; after controlling for site speed, being a google owned property shouldn't matter. It's fine if google owned sites tend to be faster and hence are more lowly ranked.

I specifically meant more along the lines of google can view your navigation through GA tooled sites, and there is a wealth of information that can be derived from that.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by curun1r on Saturday April 18, 2015 @04:01PM (#9400802)
Moreover, even if you concede that there's a single algorithm at one point in time, there's still not a single algorithm since the Google search result you get today will be the result of a different algorithm than the one that determined the result of the same query last week. It's not only necessary for the French government to ask how the algorithm works, but they'll need a daily changelog or the algorithm description will become stale quite quickly.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by stretchwithme on Saturday April 18, 2015 @04:00PM (#9400799)
One camp creates machines that actually work and coerce no one to do business with them.

The other has to use force. That's all they know how to use. Its their solution to every problem.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by mercurial on Saturday April 18, 2015 @04:34PM (#9400905)
> It's convenient to think our work is so sophisticated, and that lawmakers are simpletons. But that's a naive view.

I don't think anybody is suggesting they are simpletons. Unfortunately, French lawmakers are fairly tech-illiterate on average (as demonstrated by the recent vote for the mass surveillance law).

That said, I kind of agree with you. Investigating Google is one thing, asking for them to spill their trade secrets is another.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by tomjen3 on Sunday April 19, 2015 @05:04AM (#9402489)
Technologists don't win by fighting in the legal system - the others have centuries of advantages here. If the others call KVN then they need to know that if they answer they better hope they have never used Facebook and that their daughters haven't shared any photos on snap-chat.

What we need is not to be involved in matters of law, but to have a mutual defence treaty that will ensure the law doesn't get to steal and redistribute what we make. France needs Google, but to Google France is just one customer - and they should treat them accordingly.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by rndn on Saturday April 18, 2015 @02:17PM (#9400450)
Machine learning is not heavily used in Google search: https://www.quora.com/Why-is-machine-learning-used-heavily-f...
Re:French Senate Backs Bid To Force Google To Disclose Searc... by skj on Saturday April 18, 2015 @05:18PM (#9401085)
In general, "search" or "optimization" is what we call machine learning that we've gotten pretty good at.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by Brakenshire on Saturday April 18, 2015 @12:15PM (#9399940)
Unfortunately the generation of politicians that are currently in power are by default tech-illiterate - there will be some who really know what they're talking about, but they will be those people who have needed to actively pick up that information. In general I would not bet on a randomly selected politician being able to describe what a browser is. It's a shame, because well-judged monopolies action is valuable. You can see the potential in the way that the standardization on USB has been nudged and cajoled on tablets, e-reader, phones, and tablets.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by jfoster on Saturday April 18, 2015 @11:37AM (#9399785)
Plus those factors and their weightings would be changing on a very regular basis. Then there's also the personalization and localization layers of search. Would each user be able to see the weightings specific to them, or would Google just publish the general algorithm with weightings left unspecified?

Another open question is what degree of disclosure is being requested from Google. Suppose Google just give them the daily dump of weightings and such from the machine learning systems. Does that qualify as disclosure? They may have a hell of a time trying to figure out whether there is any bias in the system using that. They may just refuse to believe how complex the system is, and think that Google is being difficult.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by DavidSJ on Saturday April 18, 2015 @11:33AM (#9399769)
If Google actually had the algorithm for a cat, I'd like to see them release that too.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by stretchwithme on Saturday April 18, 2015 @04:03PM (#9400814)
Its freely available. A copy can be found in every cell of every cat.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by ehmmm on Saturday April 18, 2015 @04:44PM (#9400953)
Algorithm is not the same as the the source code, which is what genes contain. We have obtained them trough gene sequencing, but we still don't know how organisms work and grow.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by compbio on Saturday April 18, 2015 @05:36PM (#9401157)
They have: http://googleblog.blogspot.com/2012/06/using-large-scale-bra...

Furthermore they already published their search engine algorithm: http://www.google.com/technology/pigeonrank.html

Re:French Senate Backs Bid To Force Google To Disclose Searc... by gress on Saturday April 18, 2015 @11:52AM (#9399836)
They clearly don't understand the complexity, but just because it's complex doesn't mean it's not biased, and if nobody is allowed to audit it, we will never know.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by mike_hearn on Saturday April 18, 2015 @12:13PM (#9399932)
What does "bias" even mean, in this context? I use Google exactly because I want its bias - the bias towards websites they think are good, and putting answers right in the results page.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by wyager on Saturday April 18, 2015 @12:07PM (#9399899)
So? Why isn't Google allowed to make a biased search algorithm?

And again, you might as well be saying "just because cats are complex doesn't mean they're not biased, and if nobody's allowed to audit them, we will never know". Even Google probably doesn't know the specifics of what their engine has learned.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by untog on Saturday April 18, 2015 @12:15PM (#9399939)
The central issue here is whether Google are biased towards their own services, and as such abusing their market position. The rest of the bias doesn't matter.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by JoshTriplett on Saturday April 18, 2015 @03:47PM (#9400758)
The former doesn't imply the latter. Thinking of (for instance) Google search and Google maps as two entirely separate products ignores the value of being able to search for an address in the former and automatically embed a map from the latter. That's not an example of biased search results; that's useful integration. And I can't see any possible reason why Google should be forced to make the same integration possible with MapQuest.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by gress on Saturday April 18, 2015 @05:39PM (#9401162)
The reason is that google has established a monopoly on search, and search provides market power over customer's selection of Internet services.

The reason is clear. You might want Google to have that power, or dislike the concept of antitrust, but the reasoning for the action is straightforward.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by mercurial on Saturday April 18, 2015 @04:38PM (#9400921)
> Thinking of (for instance) Google search and Google maps as two entirely separate products ignores the value of being able to search for an address in the former and automatically embed a map from the latter.

It's also useful to open a link from Word. Do you see any reason why Microsoft should make it possible to open it in anything else than IE?

The way the game works is that you can get away with vertical integration and anti-competitive behaviour as long as you are not in a situation of monopoly. Then the rules change.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by JoshTriplett on Saturday April 18, 2015 @04:42PM (#9400940)
There's a difference between clicking a link (where "open in default browser" is the obvious behavior, and there's no advantage to forcing any particular browser) and searching for an address (where it makes sense to recognize an address and offer special handling, such as displaying a map, or directions).

Searching for an address is a special case of search. If you search for an address, you're unlikely to get useful results by just searching the web, unless the address happens to be that of a business who lists their address on their site; even then, the result you want from the address is probably a map or directions, rather than the site for the business at that address. So what, precisely, would you suggest Google or another search engine do in that case to continue providing a good user experience? (Answers such as "don't do that" are obviously wrong, as are answers like "go to extra trouble to build a generic search plugin API and make users explicitly select a map provider". Neither of those provides a satisfactory experience for users.)

Re:French Senate Backs Bid To Force Google To Disclose Searc... by mercurial on Saturday April 18, 2015 @05:10PM (#9401059)
> There's a difference between clicking a link (where "open in default browser" is the obvious behavior, and there's no advantage to forcing any particular browser) and searching for an address (where it makes sense to recognize an address and offer special handling, such as displaying a map, or directions).

Clearly, there is a competitive advantage in controlling the browser, or Google would not have spend so much money in giant billboards in the Paris subway to explain how Chrome was better than anything.

> So what, precisely, would you suggest Google or another search engine do in that case to continue providing a good user experience?

Agree with map service vendors on a standard API, and make it possible in the settings to select the service to handle an address search. You know, competition and all that.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by tomjen3 on Sunday April 19, 2015 @05:07AM (#9402498)
It is not just that, if we allow that search is Googles domain then maps are also in their domain: maps are information and that is what search is supposed to find.
Re:French Senate Backs Bid To Force Google To Disclose Searc... by lazylizard on Tuesday April 21, 2015 @05:57AM (#9413047)
um. i'm thinking more along the lines like. is toyota allowed to use toyota parts to make toyota cars? or they must buy from all 3rd party suppliers? can toyota force install toyota radios? can blaupunkt ask a court to force toyota to buy blaupunkt radios?
Re:French Senate Backs Bid To Force Google To Disclose Searc... by pdkl95 on Sunday April 19, 2015 @12:53AM (#9402074)
Why? Because new laws apply when you are the dominant player in the market. Biasing the search would be "tying"[1] if the bias is related to another market Google participates in.

See the Sherman/Clayton antitrust acts and the long list of related SCOTUS rulings.

Re:French Senate Backs Bid To Force Google To Disclose Searc... by thrownaway2424 on Saturday April 18, 2015 @12:53PM (#9400074)
You say "bias", I say "quality".