News for hackers. Stuff that matters.
Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by 6ren on Tuesday January 24, 2012 @06:45PM (#3507575)
I've noticed both (typos and stems), and am impressed with how accurate it is.

I miss literal search, and then they removed +keyword - but fortunately, quotes do it now. For example, rip and "rip" give slightly different results, with different emphasis within them: https://www.google.com/search?q=rip https://www.google.com/search?q=%22rip%22

Google's predictive search while you type is amazing, especially because it is so fast - you can select the search you want. It's tab-completion for the web. And it can be informative in itself, if you aren't sure of the right terms. (i.e. the deep search problem of not knowing what you are looking for).

I think they are doing a great job of searching for what you want - which is their goal. Technically precise searches aren't their main goal (though I wish they retained it somewhere).

However... artificially ranking their own links, ranking that isn't objective, is deadly to the utility of their search, and to their brand. In the past, google products have seemed to rank highly, but google claimed this was their natural rank. What is the evidence against them now? EDIT ok, the evidence is explicit and damning: http://www.focusontheuser.org/examples.php EDIT2 ok, I'm not getting the results they claim, at all. I'm using "google.com" but from Australia. Maybe that's why.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by dkarl on Tuesday January 24, 2012 @07:15PM (#3507671)
Google's search tweaks are making it better and better for most users. For me, though, I want the old simple-minded Google back. I would rather get what I ask for, even when when it's garbage in/garbage out, than wonder if some heuristic somewhere is filtering out the pages I want to see.

For example, I'm sure Google "knows" that I am a monolingual English speaker, but I can read enough German, French, and Spanish to struggle through a blog post telling me how to diagnose or work around a problem with my computer when that's my only choice. (Especially now that Chrome will run the whole thing through Google Translate for me.) I set an option in Google to show me pages in other languages, but these days I don't see non-English results anymore unless there are only a few pages of search results. It seems like non-English pages are penalized heavily, regardless of how high they rank as search results. (Or did everyone who used to post about technical topics in German switch to English over the last five years?)

Even if that's not true, the fact that I even think about it is a bother. I wish Google would be more simple-minded so I could have more confidence in how I understand the results.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by 6ren on Tuesday January 24, 2012 @07:45PM (#3507771)
> Google Search automatically returns results in the language you choose for Google product text, but you can also request results in many other languages.

Try setting German at "For Google text" (first on language preference page). I did, and got several german hits. Whereas, merely adding "german" for the search results (second on language preferences page) didn't add any. It's a hassle, but a solution is to change your "For Google text" setting. for each language you want.

It seems to me that the vastly greater number of english results would simply out-weigh the german resuls. The german results will still be there, but ranked much lower.

What's curious to me is that you say Google didn't formerly do this. Maybe they changed the weighting of the various languages from being equal to being weighted according to the results.

Probably searching with german terms will get german results, but again a hassle because you have to do it for each language.

EDIT following guelo's comment on "verbatim" under "All Results -> More Search Tools" on the left hand side, there's also a "Translated foreign pages" option. This gave me several results in other languages. Sounds like what you want.

BONUS: I noticed a "Search English and German pages" just under "Search the web" on the left hand side (I added German as a search language above). I think this is precisely what you wanted.

Google is impressing me.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by dkarl on Tuesday January 24, 2012 @08:46PM (#3507987)
Google is impressing me.

Really? All that to get what I used to get for free? Not to mention that German is just one language, and "translated foreign pages" sounds like it might search the translated text, which is nice, unless it doesn't deliver results in untranslated pages, which leaves me wondering whether Google translates all pages or just some, and whether it's sufficiently integrated with Google Translate to filter out words that can't be translated, which are often exactly the words I want. That puts me right back where I started, sitting in front of Google wondering how the hell it works and what it's filtering out of the internet as a result.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by 6ren on Tuesday January 24, 2012 @09:09PM (#3508052)
Wow, I go to some trouble to research your question for you, but you reply in complaint without trying it out. e.g. try it with more than one language selected for search. You can also test your questions with specific queries (e.g. using terms that seem unlikely to be translated). Also, consider that you didn't know what results Google wasn't returning in the first place, years ago (e.g. by not having indexed them).

Google aims at working without thought. But it can only do so for one target audience, and unfortunately for technically minded folk, that target has to be mainstream users. Fortunately, technical folk are usually curious to explore and customize technology.

EDIT just confirmed that it does use added search languages, as expected. e.g. if I add german and french, it provides: "Search English and French and German pages" Note: I'm not doing this for you; but because I'm curious.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by dkarl on Tuesday January 24, 2012 @09:44PM (#3508148)
To be absolutely clear, I'm complaining about Google, not you, and I already said Google's behavior is better for most users. I'm not really sure what more I can say to be "nice" and still be honest, because I am angry that I was missing search results because of a behind-the-scenes change that I would only have discovered if I was regularly checking my preferences to see if the choices I made have been superseded and contradicted. And that's what I found: when they created this settings page they erased whatever language settings I had (which I think was just "yes, I would like to see languages other than English") and left only English selected.

Honestly, you shouldn't be so sensitive that you perceive criticism of a web app as criticism of your advice, or assume that I didn't check up on it. I just wasn't happy about what I found. Per my first post, all I want is to be able to use Google and understand roughly what it's doing, and it failed very badly in this case, since the one thing I was counting on it to do -- include foreign language pages, because I asked it to -- was actually the thing it wasn't doing.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by 6ren on Tuesday January 24, 2012 @10:40PM (#3508293)
> Not to mention that German is just one language

You can add more than one language. If you'd checked up on it, you would have seen that. I perceive this as complaining about advice without following it, and I find it annoying.

If you're still angry (and it sounds legitimate, especially if there was a subtle hint of a problem, but not enough to register fully), that explains where you're coming from, which puzzled me.

Aside: Unfortunately with webpages/webapps, they can and do get updated continuously, without explicit version changes or any notification at all. Ideally, all changes would be back-compatible, but then you end up with a mess (both in user interface and implementation). Continuous notifications amounts to spam, and is usually ignored (I do). Change is a problem. I'm not sure there's a solution.

I think back-compatibility is a deep, abiding, practical problem, in general.

EDIT "if the choices I made have been superseded and contradicted": just realized this is more than merely "backcompatibility of UI". In effect, they have destroyed your data. Although that sounds overdramatic, since the data itself is very minor (perhaps one bit, a binary checkbox), it's a clear trigger for notification. There might be some grey area for when your configuration is still there, but has a different meaning - but I think you're saying that your config is no longer there, and/or no longer has an effect.

I used to use Yahoo finance, and they had a nice display of 9 user-configured stocks at the top. In their latest redesign, this disappeared, and I couldn't find an option to bring it back. This was enough to make me spurn their product, and switch to google finance. It makes me think they have no idea what they are doing. I guess in this case, I had notification (as I could see it was gone). But if they had an explicit reference to it going away, even if it said "sorry, this is going away", I would feel better about it. And I have a sneaking suspicion that maybe it is still available somewhere, and I just couldn't find it.

So, changing the meaning of a user-specified configuration should probably trigger an explicit notification (and force the implementer to consider it); and deleting user-specified configuration should never happen, even if it has no effect. I think it should be treated as sacrosanct as other data stored (e.g. gmail emails, dropbox files etc). If changes render it ineffective, it should still be there, but with a notice: "this no longer works, use this instead". Again, this forces the implementer to thin about what they are doing.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by dkarl on Wednesday January 25, 2012 @12:19AM (#3508502)
Not sure why I thought I couldn't respond to you directly, but I deleted the other comment and moved it here where it belongs:

Re the "just one language" thing, I can imagine I'm not making sense, because I'm not really communicating the context of how irrationally enraged I am over this. The truth is that I only enabled a couple of languages because I was just too angry and frustrated to enable the rest. I know it doesn't make any rational sense, but my reptile brain is telling me that goddammit, Google is not going to make me click on fifty little boxes just to fix them erasing my preferences. Not today. Not this user. There is a part of the brain that is trained to recognize when someone is jerking you around or abusing you, and when it gets triggered inappropriately, it is impossible to turn off. (I'm sure anyone who has worked in customer service will recognize what I'm talking about. Right now I am the bug-eyed paranoid who is convinced they are intentionally screwing with me for their own amusement.) So long story short, yes, it seems immensely important to me that I have to check fifty boxes instead of one, and I still don't have my unfiltered search results, not until I calm down enough to go click on all those boxes.

As for the problem of change, I can sympathize with the problem they face. I'm sure that globally minimizing user confusion and frustration is one of their goals. As for me personally, they'll have to count me in the "used the product incorrectly for years without realizing it and is now very angry about it" category.

UPDATE: EVEN ANGRIER:

So I swallowed my pride and went to work clicking.

"The page at https://www.google.com says:

The number of language restrictions is limited to 8, so only 8 of the languages selected will be saved."

That doesn't bode well. But then: "The page at https://www.google.com says:

Your preferences have been saved"

Ah, but guess which time it was lying :-/

So unless there's another way to turn off language filtering, Google will filter out every language besides your primary language and seven others. (Yeah, your interface language counts as one of the eight.)

That's terrible. Even without Google Translate, I swear I got useful information from a page in Polish once. Plus there are pictures, video, miscategorized pages, mixed-language pages (what happens with those?) and the simple coolness of finding out that someone in Vietnam is using an open-source library you committed a patch to. And of course, Google freakin' Translate! Unless Google is translating every single page it crawls. Which it might be -- that's something to think about. But it does very poorly with some pairs of languages, and if it filters out every term it can't translate, then it will tend to filter out commands and symbols. And here I am speculating about how it works again, which goes back to my original point.

With my track record today, I'm sure I'll find out I'm misinterpreting this somehow, but I'm starting to feel a little bit justified in my anger. Ah, I can't lie. I feel much less angry now that I feel like less of a fool :-)

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by 6ren on Wednesday January 25, 2012 @02:13AM (#3508711)
HN disables the reply button on long threads, for a period of time which increases with the length of the thread. This is to discourage back-and-forth arguments and to give people time to cool down. (You can circumvent it by clicking "link"; a reply box appears beneath.)

I'm with you on the inappropriately triggered jerking-me-round neuron. I am definitely there from time to time :-). You put it well. When in that state, I don't really believe that someone in the real world is messing with me - but inside my world, I believe someone is. I think that I can't quite see the real world in that state (or don't want to). Funny thing is, if I find out someone is messing with me, I also feel less angry...

Oh man, that's awful. And that "limited to 8" dialog pops up for each checkbox. Seems a really badly designed interface in general. I wonder why the limit? Maybe they keep languages separate, because effective pagerank criteria differ across languages/cultures; and they're limiting internal bandwidth needed to combine the results from distant databases.

I was going to say you could just include the languages you can read (and where you often found useful info before); but I appreciate your point about seeing the whole web (I guess, the www), across languages.

I've had a play with google translate, and I noted that untranslated words seem to pass through, unaltered (using the text-based one, eg: http://translate.google.com/?hl=en&tab=wT#auto|en|Je%20n... ) You could probably see by trying example pages til you find a word it doesn't know. It seems much more useful to include an untranslated word than to omit it, so hopefully they do it that way.

Given the 8 limit, this seems the best option for seeing the whole web - and if the translation is any good at all, it might be better. I might try this (though I recall reading something that I didn't notice was auto-translated, and after reading for a while, suddenly becoming aware that I had no idea what it meant...)

I wonder if just plain more information about a situation reduces anger, because anger relies on one's internal view of the world? The more acquainted we get with the real world, the harder it is to sustain anger. (Aside: The Buddhists say all negative emotion is based on ignorance or misconception - of seeing something as 100% absolutely negative - and so negative emotion can be reduced by deeper understanding.)

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by landhar on Wednesday January 25, 2012 @07:34PM (#3512399)
I faced the same problem. I am fluent in 4 languages and can work my way on a few others. But the problem is not that it's limited to an arbitrary number of languages. The problem is that it doesn't feel anymore like what I'm getting back from any query is the full web.
Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by joebadmo on Tuesday January 24, 2012 @07:09PM (#3507649)
However... artificially ranking their own links, ranking that isn't objective, is deadly to the utility of their search, and to their brand. In the past, google products have seemed to rank highly, but google claimed this was their natural rank. What is the evidence against them now?

I think the notion of objectivity in search is a fallacy, and I would hesitate to characterize the addition of social search as artificial inflation, at least not any more artificial than any other part of the algorithm. The fact is: Google has more information about how to rank G+ profiles than any other profiles. That extra information adds google juice. Yes, other social networking profiles are indexed and ranked, but Google doesn't have the appropriate extra information on them that it does wrt G+.

This doesn't seem particularly hard to understand, and I'm not sure how the focusontheuser.org bookmarklet illuminates the issue. I agree that the G+ profiles are probably given too much weight, and that's probably for two reasons: 1. It's brand new and requires more data for calibration; 2. It props up G+ as a product.

From Google's perspective, even if search quality is negatively impacted in the short term while they calibrate and funnel users into G+, as long as in the long term search quality is bolstered by the additional subsequent data, it's a win.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by 6ren on Tuesday January 24, 2012 @07:25PM (#3507710)
Yes, I agree that social search can improve accuracy, and that google knows more about its own social information so it can use it more accurately.

Artificially inflating that, for the purpose of pushing their product, is the problem (that's how I'd define "artificial ranking" - ranking on a basis other than returning a page of search results for the user). This avoids the problematic term "objective".

I don't buy the "means to an end" argument. If google really is doing that, it means worse search results, loss of user confidence, and antitrust litigation (abuse of market power).

BTW: the first search example "people and places" seems to require a google+ account (as it wouldn't give me results unless I signed up). I'm happy for a google+ search to yield google+ results.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by ekianjo on Tuesday January 24, 2012 @09:15PM (#3508074)
I am not sure about the "antitrust litigation" claim you make. Nobody is forcing anyone to use Google. There are tons of old search engines and new ones coming up every year. This is very different than having a computer where Windows is installed by default, instead of having the choice of your OS.

It's like saying Facebook is also "abusing its market power" because it only shows you contacts on Facebook and not on Google+. Sorry, but this cannot work this way, when you are on one network, you agree with the principles of that network, or you use another. There's no lack of options out there.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by 6ren on Tuesday January 24, 2012 @10:59PM (#3508340)
I was thinking of antitrust suits for abuse of market-power. i.e. not about how you got it, but what you do with it. So the analogy is microsoft using their market-power to bundle their media player. BTW Bill Gates thought as you did, that this was perfectly legitimate.

Your point about alternative search engines, and Windows being hard to avoid, is relevant for another kind of antitrust.

Aside: though, I think google is still far and away the best, in terms of response time (especially for predicting search queries as you type - that requires huge local data centres all over the world). e.g. Duck duck go has great features, but it's just too slow (at least, over here in Australia). Who can afford data-centres everywhere? (maybe Amazon...) Google also has one of the strongest brands in the world. So, the choice is kind of figurative. It's an earned monopoly, not earned through abuse, not bad or wrong; but a monopoly nonetheless.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by ekianjo on Tuesday January 24, 2012 @11:13PM (#3508371)
On Microsoft, (to close the loop), I think it is legitimate for them to include the software they want with Windows (such as IE, media player and all), however it is not normal that hardware manufacturers sell you computers only bundled with Windows and nothing else. That is where the abuse is, for this case.

I think the term "abuse of market power" has very thin legal ground. Anything that becomes popular tend to appear like it "abuses" its power. That's usually what competitors say when they simply give up competiting: they use lawyers and politicians to weaken the leader.

What matters in the end is what value the service provides, and if there is choice available for users to turn to other alternatives. If Google does not provide value anymore (irrelevant results) it will consumers/users in the end, and that will spark demand for better alternatives. The market will adjust. I do not really see an issue with the current situation.

Regarding search engines, Bing and Yahoo may not be as relevant but they also do the job most of the time. There will be new competitors coming, web contents are changing, the way people use the web are changing, all this environment creates opportunities to challenge search on the way. Looking through pages of results of links is hardly something that can be optimal over the long term - we will need better tools, I have no doubt about that.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by 6ren on Wednesday January 25, 2012 @02:26AM (#3508743)
I was saying it means antitrust litigation; you're saying it shouldn't. :-)

Yes, change may bring new competitors that could upset google - disruption seems the destiny of most tech companies, it's just a matter of time. Interestingly, what we're seeing right now is a valiant effort on Google's part to shift from pagerank to "social-rank", in response to facebook, a new competitor. Going by history (as in "The Innovator's Dilemma", google as the incumbent will succeed if the technological innovation serves their business model - which it does.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by blakeross on Tuesday January 24, 2012 @11:08PM (#3508359)
That's incorrect. The hardcoded Google+ results in the "People and Pages" box, as well as the other two hardcoded locations outlined on this page (http://www.focusontheuser.org/examples.php), appear for all Google users -- whether or not they have a Google+ profile, and even whether or not they're logged into Google. You can see that in this video, which is conducted in a Chrome incognito window in logged-out Google: http://www.focusontheuser.org/video.php

If you're not seeing the Google+ results on some pages, it's just because Google is still in the process of rolling out the feature.

Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by thrilway on Tuesday January 24, 2012 @09:11PM (#3508061)
I absolutely agree. There's no objectivity in ranking search results.
Re:Larry Page to Googlers: If You Don’t Get SPYW, Work Somew... by guelo on Tuesday January 24, 2012 @08:01PM (#3507826)
> Technically precise searches aren't their main goal (though I wish they retained it somewhere).

There is the 'Verbatim' search option hidden on the SERP page on the left hand side under All Results -> More Search Tools -> Verbatim