News for hackers. Stuff that matters.
Re:I'm Not Japanese by patio11 on Wednesday August 22, 2012 @02:52AM (#4416328)
>> Does Google assumes that we live in The Matrix, and you can learn a new country’s language instantly as soon as you move there? >>

Google is making the (accurate) calculation that over 99% of people coming from a Japanese IP address whose computer says "Accept-Language: en-gb;q=0.9, en;q=0.7" are actually Japanese speakers of Japanese (true preference: "Accept-Language: ja-jp;q=1.0; en;q=0.000001") whose configurations have been borked at the manufacturer or the IT department level, and who will be terribly served by content written in English. It's an act of charity that they even ask about English prior to defaulting you into Japanese. (They haven't always done that -- every year or two it seems to switch for me.)

This is a particularly acute issue since most users of Google don't actually have accounts on it, their best attempts to fix that to the contrary. As a result, in key ways such as language, the service needs to "just work" for the majority of their users. Also, if I was to have a totally clinical view of the situation, the expected value of 1 English speaker in terms of ad clicks is ridiculously below the expected value of 1 Japanese speaker in terms of ad clicks, given that both are in Japan (+), and you're asking to sacrifice 99 Japanese speakers to save the 1 English speaker. Once you accept that there will be a loser in this decision either way, figuring out who the loser should be is not that hard. Sorry: I'd prefer English, too.

>> And by the way, want to check out a post on Blogspot? Off to blogspot.jp you go. This doesn’t change the page itself, only the URL. So what does redirecting me accomplish, except make me feel that I’m not in control of what sites I can access? >>

This is a hack around censorship laws in a few places (most relevantly to the instant case, Germany, I believe). Google has a blogspot.jp which is a copy of .com which is a copy of .de which is a copy of... except that they enforce country-specific censorship laws. This was deemed an acceptable tradeoff versus getting all of blogspot blacklisted in e.g. Germany.

n.b. No special inside knowledge here.

(+) If this is not intuitively obvious to you talk to me about AdWords geotargetting and default settings sometime.

Re:I'm Not Japanese by davidw on Wednesday August 22, 2012 @03:27AM (#4416401)
I am logged on to Google, and they know I want English results and an English interface, because I've gone through and done all the settings. And yet, occasionally something goes wonky and they start showing me the interface in Italian again.

I have no problems if their default is the local language - that's pretty much a no-brainer - but when I've told them in no uncertain terms what my own preferences are, they ought to respect that.

Re:I'm Not Japanese by cocojumbo123 on Wednesday August 22, 2012 @04:30AM (#4416505)
Same here. I travel a lot and use VPN to access the corporate network. So if I am in the Chinese office google goes Chinese (and it takes some random guessing to switch the language back to English) then in the hotel (via VPN) it promptly goes German.

One small improvement would be to write the name of the language in the original and not in whatever country's version. (e.g. English instead of Angol, etc).

Re:I'm Not Japanese by hessenwolf on Wednesday August 22, 2012 @03:36AM (#4416421)
It randomly flicks in and out of German for me all the time (I live in Germany). I have ravaged the settings to change this, but to little effect. At least I am gradually getting better at German!
Re:I'm Not Japanese by MagerValp on Wednesday August 22, 2012 @05:19AM (#4416609)
For some reason I tend to get Google's authentication pages in Hungarian (at least I think that's what it is), despite being in Sweden with sv_SE/sv/en_US/en configured in the browser and Google's services set to use English.

Fun!

Re:I'm Not Japanese by Jacobi on Wednesday August 22, 2012 @03:50AM (#4416436)
For me sometimes it switches to Arabic even if I set the settings. And here in north Africa most people are francophone and prefer French or English !
Re:I'm Not Japanese by rickmb on Wednesday August 22, 2012 @04:18AM (#4416478)
> Google is making the (accurate) calculation that over 99% of people coming from a Japanese IP address whose computer says "Accept-Language: en-gb;q=0.9, en;q=0.7" are actually Japanese speakers of Japanese

Google is making the (completely wrong) assumption that those people cannot type google.co.jp instead of google.com and make their own choices.

But at least in Japan they're probably right about the language. Google pulls the same crap in multilingual countries, and gets it wrong a lot of the time. This isn't Google being smart, this is Google being lazy and insensitive.

Re:I'm Not Japanese by nandemo on Wednesday August 22, 2012 @06:24AM (#4416702)
> Google is making the (completely wrong) assumption that those people cannot type google.co.jp instead of google.com and make their own choices.

You're making the completely unsupported assumption that the average internet user understands domain names. Like patio11 suggested, if a user from a Japanese IP is accessing google.com, it's likely that this address was pre-configured in some way: the search bar was set up like that, or the company sysadmin set up the home page like that. But even if the user manually typed "google.com", if they're in Japan it's still (way) more likely that they wanted a Japanese version rather than the English one.

Re:I'm Not Japanese by rickmb on Wednesday August 22, 2012 @09:21AM (#4417180)
Come on, most users outside the US are perfectly used to a plethora of international TLD's. It's something they are quite familiar with.

Also, they either use the English version of the OS and browser, or the one in their language, and both come with the default correct preferred language settings.

The same goes for company systems. You don't give someone who can't handle English an English language system, and the idea of setting up a system in language X but pre-configuring that in some what that English becomes the preferred browser language is a really odd edge case.

Even if such scenarios are more common, it still doesn't excuse telling people that make explicit choices to go fuck themselves, especially in multi-lingual countries where such explicit choices are common.

Japan may be relatively homogenous, but most countries in Europe are either formally multilingual or have large immigrant populations. Many thousands of people are regularly being confronted with misplaced assumptions about their preferred language.

You can't assume language from geo-IP databases, it is the most unreliable and inappropriate method imaginable, and you are 100% sure to regularly piss people off.

Re:I'm Not Japanese by mikeash on Wednesday August 22, 2012 @11:11AM (#4417714)
What method is more reliable than guessing the language based on the IP address?
Re:I'm Not Japanese by yevuard on Wednesday August 22, 2012 @12:10PM (#4418069)
Ask the user, remember preference. Possibly Accept-Language (note - not locale, as locale != language). But, ask the user.
Re:I'm Not Japanese by chc on Wednesday August 22, 2012 @02:49PM (#4418916)
That's kind of orthogonal to how you guess the user's language. It is, in fact, what Google is doing.
Re:I'm Not Japanese by rmc on Wednesday August 22, 2012 @07:45AM (#4416853)
Agreed. Talk to mundane users. You will find out that many of them go to Facebook by typing "www.facebook.com" into Google's search bar.

People don't know the difference between the google search bar and the address bar.

Re:I'm Not Japanese by shock3naw on Wednesday August 22, 2012 @05:06AM (#4416576)
Google isn't being lazy & insensitive. I18N is hard.
Re:I'm Not Japanese by ZoFreX on Wednesday August 22, 2012 @05:33AM (#4416632)
> I18N is hard.

Understatement.

Re:I'm Not Japanese by columbo on Wednesday August 22, 2012 @11:30AM (#4417832)
Shouldn't US users then be using google.us, and uk users use google.co.uk and should google.com just redirect to the language of the location of the user?
Re:I'm Not Japanese by jarek on Wednesday August 22, 2012 @04:03PM (#4419268)
Yes. But google.us acts the same as google.com when it comes to location redirects though (e.g., I have a Canadian IP and en-us;0.9 Accept-Language, it redirects me to google.ca).
Re:I'm Not Japanese by ktizo on Wednesday August 22, 2012 @04:42AM (#4416537)
It asked her if she wanted Japanese and she clicked yes and it gave her Japanese. What crap do you think anyone is pulling here?

Also, if in Japan, I would be surprised to find google.com not to be in Japanese, and I would expect to have to perhaps make some kind of preparations for the fact that the majority of the world does not speak my language and that my electronic devices and services are not universal metatrons run by omnipresent deitys either.

Re:I'm Not Japanese by briandear on Wednesday August 22, 2012 @10:00AM (#4417349)
Yes, but google.co.jp does just fine. The automatic country redirects are the main issue. I wouldn't go to Microsoft.com and expect it to be in Chinese any more than if I went to Baidu.cn and expected it to be in English. The country domain is the ideal way to handle regional preference, I don't need the software doing it for me. I'm not an idiot, stop treating me like one.
Re:I'm Not Japanese by tommi on Wednesday August 22, 2012 @12:13PM (#4418097)
Country domain is the worst way to handle language preference. We already have a perfectly valid way to handle language preference with Accept-Language. There is no need to register domain under every possible country domain you could localize. And countries do not equal languages. Bilingual countries would be screwed if country domains were the only option.
Re:I'm Not Japanese by tjoff on Wednesday August 22, 2012 @04:07PM (#4419289)
Why is it the worst way to handle language preference?

If you are a local you are probably very used to your country domain, it is probably on par with .com.

Now the Accept-Language is quite subtle and guess how that is set up in an internet café? Can you even change it? Will the next customer be happy about that? I'd be mighty impressed if more than 1% of the people that surfs the web has a clue about Accept-Language.

Also, if one asks for a local country domain that really should be the localized version, sometimes I actually want to use google for a language different other than my own.

If I for instance wanted to search in English on something that has a similar wording as Swedish I'd like to go to google.com in order to quickly get rid of the Swedish-bias (since that doesn't work I sometimes use google.co.uk instead).

Re:I'm Not Japanese by aptwebapps on Wednesday August 22, 2012 @12:12PM (#4418089)
Yes, but you're going to run into the problem that patio11 pointed out. You are in a tiny minority and they don't want to inconvenience the vast majority just because your preference is 'better'.
Re:I'm Not Japanese by billswift on Wednesday August 22, 2012 @12:25PM (#4418161)
>I'm not an idiot, stop treating me like one.

Many people are however, and mass media, which includes Google, however they may try to deny it, lives by the numbers, which means adapting to the lowest common denominator. Just think, as the Internet spreads, Google will evolve (devolve) closer and closer to broadcast TV!

Re:I'm Not Japanese by ktizo on Wednesday August 22, 2012 @04:53PM (#4419516)
If I was in China and looked at microsoft.com, I would think they were absolute idiots if it didn't default to Chinese. If you don't localise for all your major territories from your .com domain and force them to use a country domain instead, then you should shoot your marketing director immediately.
Re:I'm Not Japanese by JohnsonB on Wednesday August 22, 2012 @03:28AM (#4416402)
>Google is making the (accurate) calculation that over 99% of people coming from a Japanese IP address whose computer says "Accept-Language: en-gb;q=0.9, en;q=0.7" are actually Japanese speakers of Japanese

From the article:

>The problem is compounded by the fact that most of the time, you have no way of doing anything about it. And when you can do something, it’s often buried in layers of menus, which –don’t forget– are all in Japanese, Bhutanese, or Martian…

I think you're missing a key point in the article.

Re:I'm Not Japanese by chc on Wednesday August 22, 2012 @02:53PM (#4418941)
This is only a problem for those who:

1. Are in the tiny minority of people in Japan who don't speak Japanese

AND

2. Chose to switch to Japanese when Google asked them if they'd prefer Google in Japanese or English

Google guessing that she might have been Japanese was not the major problem here. The ultimate problem was her incorrectly stating her language preference. It's hard to see what reasonable measures Google could have taken to inconvenience fewer people here.

Re:I'm Not Japanese by JohnsonB on Wednesday August 22, 2012 @04:26PM (#4419393)
Actually, it's a problem for anyone who speaks a language that is different from the official language of the country they are in, and don't have a Google account (a lot of people.) In any case, a persistent language menu on all Google properties that has all languages available would solve either and all other problems associated with language choice.
Re:I'm Not Japanese by znowi on Wednesday August 22, 2012 @07:14AM (#4416781)
Most browsers set the default Accept-Language header correctly. If some IT department screwed it up, it's not the reason to ignore the standards. My HTTP request data should be a priority over my IP address location. And Accept-Language is just that mechanism to set a preferred language for the response.

In all my travels I had to deal with language issues from Google. But it goes beyond that, as the vast majority of i18n'ed sites favor IP location over Accept-Language. I find this trend saddening.

Re:I'm Not Japanese by freehunter on Wednesday August 22, 2012 @10:28AM (#4417482)
Yeah, if an IT department messed up, call the helpdesk and complain. The setting will either be fixed or support should be able to get you through the menus to correct the setting on your own.
Re:I'm Not Japanese by sgdesign on Wednesday August 22, 2012 @02:59AM (#4416346)
I agree with you for logged out users, but these things happen even when you are logged in.
Re:I'm Not Japanese by zalew on Wednesday August 22, 2012 @03:13AM (#4416368)
> This is a hack around censorship laws in a few places (most relevantly to the instant case, Germany, I believe). Google has a blogspot.jp which is a copy of .com which is a copy of .de which is a copy of... except that they enforce country-specific censorship laws. This was deemed an acceptable tradeoff versus getting all of blogspot blacklisted in e.g. Germany.

what event/law are you referring to? why blogspot should be censored in germany?

Re:I'm Not Japanese by patio11 on Wednesday August 22, 2012 @03:20AM (#4416384)
Germany has many laws which are different that e.g. the USA. In particular, in the US certain sentiments which are politically and socially radioactive are protected by the US Constitution and the laws, traditions, and expectations of the American polity. Germany is similar in some regards but there is one particular politically and socially radioactive statement you could make -- support for the Nazi Party -- which, owing to the laws, traditions, and expectations of the Germany polity, will result in the government coming down on you like a ton of bricks.
Re:I'm Not Japanese by zalew on Wednesday August 22, 2012 @03:43AM (#4416427)
I know Germany and many other countries in Europe are more sensitive about promoting extreme viewpoints. My question was more about something specific related to censoring blogspot, and how the domain redirects are used to bypass that. I mean, how does it matter what domain is used to display the same content? OP says he's redirected to blogspot.jp - what problems does it solve for Google?
Re:I'm Not Japanese by DanBC on Wednesday August 22, 2012 @04:39AM (#4416529)
> * how does it matter what domain is used to display the same content?*

It only displays the same content if that content is compliant for the local region.

Thus, in the Nazi example, all off blogspot get the posts except blogspot.de, who filter it out somehow.

That's something that Youtube doesn't do with adverts very well - I'm in the UK, I've not left the UK, my IP geolocates to the UK, but I often get US ads in Youtube. Advertising law is different and often the ads are not compliant for the UK.

Re:I'm Not Japanese by jgeralnik on Wednesday August 22, 2012 @04:32AM (#4416509)
Presumably articles that need to be censored in Germany would be censored on blogspot.de and not on blogspot.com, so Germans are redirected.
Re:I'm Not Japanese by rhizome on Wednesday August 22, 2012 @03:33AM (#4416415)
All countries have different laws in this department, but moves to segment or restrict Internet content all kinda goes back to a French case against Yahoo a while back:

http://en.wikipedia.org/wiki/LICRA_v._Yahoo!

Re:I'm Not Japanese by curiouscats on Wednesday August 22, 2012 @04:28AM (#4416498)
I have noticed this in referral logs. They do it for tons of countries (I would guess all based on how many I see). Does Google automatically remerge all that to treat it as one domain for pagerank (so links to those separate domains are just treated as if they linked to the .com page), duplicate content, etc.?
Re:I'm Not Japanese by kulkarnic on Wednesday August 22, 2012 @11:32AM (#4417841)
This is not entirely so. When I visited Japan, my browser prompted "We've detected you've moved to Japan, would you like to change..."

That to me seems wrong. No one learns a language in 7 hours.

Re:I'm Not Japanese by dllthomas on Wednesday August 22, 2012 @01:32PM (#4418494)
But many people learn a language before going to a country, and some portion of those will want to use it because switching back and forth between languages can be hard. I don't think it's a bad question to ask, at all.
Re:I'm Not Japanese by jarek on Wednesday August 22, 2012 @04:06PM (#4419286)
You could speak both and prefer to use the Japanese version when in Japan (to get better local results, for instance). The site has no way of knowing your particular situation, so they ask rather than defaulting to one or the other.
Re:I'm Not Japanese by cpach on Wednesday August 22, 2012 @01:08PM (#4418363)
»This is a hack around censorship laws in a few places«

Wow, I had no idea. I thought it was some obnoxius kind of load-balancing or something like that :)