News for hackers. Stuff that matters.
Re:Please, delete all new places since the start of war 23th... by modeless on Tuesday March 01, 2022 @03:32PM (#30519613)
That's why some countries have weird regulations about maps. South Korea does not allow exporting vector maps, so Google Maps rendering is vector based everywhere except in a region surrounding South Korea [1]. China applies a (not so) secret pseudorandom offset to all geographic coordinates in online maps, frequently resulting in mismatches between systems that apply corrections and those that don't. It seems silly during peacetime but when there's an actual war, you can see why people might want that kind of thing.

And militaries all over the globe do use Google Maps extensively, if not by policy then just by soldiers doing their own thing. Wrong borders in Google Maps have nearly led to international incidents when soldiers ended up on the wrong side of a border. And then there are the disputed borders that Google is forced to display differently in different countries. There is no globally accepted map and as a result the map Google shows you changes depending on where you're located.

[1] Actually I am out of date, it looks like the South Korea maps are vector based now. Maybe the law changed. It definitely used to be the case.

Re:Please, delete all new places since the start of war 23th... by the-rc on Tuesday March 01, 2022 @04:03PM (#30519963)
The law as I recall it a decade ago was a bit more specific: you could only store and process the data in South Korea. Thus, the whole planet's tiles were rendered in production on Borg, except for SK, whose tiles had to be rendered on a workstation under somebody's desk in the Seoul office. That meant no fancy mapreduces, let alone any rendering on the fly like the Maps API allows (selecting what details to show on the map, their look, etc.). Then, IIRC, the rendered bitmap tiles had to be pushed from the workstation to production. Vector maps, at the time, would have been heresy. Google asked for years to have the laws changed. Korean companies weren't affected, at least until they moved their own rendering to e.g. a cloud provider outside the country.
Re:Please, delete all new places since the start of war 23th... by lifthrasiir on Tuesday March 01, 2022 @04:19PM (#30520138)
> Google asked for years to have the laws changed.

The laws Google asked for changes were not limited to the mapping laws but any law to require domestic data centers, which might trigger the domestic tax issue at any moment. Your explanation that Borg couldn't handle domestic clusters doesn't clearly explain that Google eventually established SK data centers and started supporting vector maps anyway---and given that South Korea is not the only country with such requests (e.g. EU), not being able to cope with such laws is just a Google's fault.

Re:Please, delete all new places since the start of war 23th... by joatmon-snoo on Tuesday March 01, 2022 @06:13PM (#30521352)
> doesn't clearly explain that Google eventually established SK data centers and started supporting vector maps anyway

Google data centers != Google cloud data centers

The two are logistically very different and consequently that means the types of workloads they host are also different. The latter is really for GCP usage only (both customers and Google-internal cloud infra necessary to host GCP). Compare https://www.google.com/about/datacenters/locations/ with https://cloud.google.com/about/locations.

Re:Please, delete all new places since the start of war 23th... by lifthrasiir on Tuesday March 01, 2022 @06:30PM (#30521507)
Oh, you are right. I'm aware of the difference, but I didn't realize that there were no new data centers as opposed to new GCP regions due to my dodgy reading. But then there are two possible scenarios:

1. SK vector maps were generated using domestic servers (but no Borg) as SK govt demanded.

2. Google "secretly" exported SK maps and generated vector maps using Borg anyway.

And both scenarios are problematic. The former would mean that the GP's claim that vector map generation requires Borg is not true or at least exaggerated (this scenario was what I had in mind when reading my sources, hence no verification). The latter would mean that... well, Google is in direct violation of SK law and not even trying to hide that.

Re:Please, delete all new places since the start of war 23th... by the-rc on Tuesday March 01, 2022 @09:09PM (#30522818)
I don't know the state of the Borg fleet or how Google Maps serves vector maps for SK today. That's why I said upfront that I was talking about the state a decade ago. Back then, what I heard was very specific, about restrictions on map source data. Not tiles, not realtime traffic, not Gmail, not account data, not search logs, not ads, etc. Even then, it was already an old issue.

Tax reasons might have arisen since, but maybe we're talking about different laws? I don't know. Do you?

The fact that there's no mention of Seoul at "Discover our data center locations" https://www.google.com/about/datacenters/locations/ tells me that its GCP region is most likely rented space in someone else's buildings and there are no full-blown Borg clusters with their usual tenants. Choosing where to build was always a complex process. There have been cases where announcements were made and land was bought, but nothing ever got built.

My explanation that.. "Borg couldn't handle domestic clusters"? What does that even mean? You could probably bring up a toy single-master Borg cell on a workstation with the right 283 command line flags and a toy Chubby cluster, but that still won't give you any map tiles.

Back in the days before incremental map updates, the whole globe's data came from a pipeline of pipelines and mapreduces, stitched together by a number of teams (the project's codename started with O). It was tracked with advanced technology (Google sheets) by PMs that had a taste for suffering. The latency was measured in weeks and months. If you missed the build, your data or code changes would take who knows how long to go live. I think that sometimes builds might have been abandoned altogether. These were the days when mobile Maps, if they existed at all, lagged desktop tiles by weeks or months (there wasn't one set only...). Same with navigation. The amount of data has only increased since, but there's obviously a much more advanced process at work nowadays. I don't know what they changed or how.

Anyway, back then, to build the SK tiles with the same tools you would have needed Borg, yes, but also Bigtable, GFS and a wide assortment of ancillary services. How are they doing it now? Maybe they finally got a license. Maybe they got a sufficiently limited subset of the full feed. Maybe they did a major rewrite of the code, pipelines and even binaries to make it feasible for that chunk of the planet to be handled by a bunch of bare Linux machines on GCP or AWS in South Korea. You might be able to deduce something by comparing updates there vs the rest of the world, but that takes time and dedication.

Re:Please, delete all new places since the start of war 23th... by lifthrasiir on Tuesday March 01, 2022 @04:02PM (#30519958)
> Actually I am out of date, it looks like the South Korea maps are vector based now. Maybe the law changed. It definitely used to be the case.

The South Korean mapping law allows for the domestic service (still subject to slight censorship), but Google didn't want to put any servers other than edge servers to South Korea so as a sort of protest it essentially froze the map for South Korea from November 2016 to December 2021, when Google finally gave up and established a new domestic data center.

Re:Please, delete all new places since the start of war 23th... by lifthrasiir on Tuesday March 01, 2022 @06:41PM (#30521597)
Edit: as joatmon-snoo [1] pointed out, there were no new Google data center as opposed to new GCP regions in SK. I mistook my sources due to my dodgy reading. That said, I now have an even stronger suspicion; see my reply to joatmon-snoo for details.

[1] https://news.ycombinator.com/item?id=30521352

Re:Please, delete all new places since the start of war 23th... by perihelions on Tuesday March 01, 2022 @03:53PM (#30519854)
- "Wrong borders in Google Maps have nearly led to international incidents when soldiers ended up on the wrong side of a border"

Probably referring to this:

https://news.ycombinator.com/item?id=1873285 ("Nicaragua Raids Costa Rica, Blames Google Maps")

Re:Please, delete all new places since the start of war 23th... by vsareto on Tuesday March 01, 2022 @06:21PM (#30521427)
>Wrong borders in Google Maps have nearly led to international incidents when soldiers ended up on the wrong side of a border.

Speaking of, if you go click on the Ukraine label right now on Google Maps, you won't get the red outline showing their border. Click on a neighboring country label for a comparison.

Belarus: https://www.google.com/maps/place/Belarus/@53.696013,25.7358...

Ukraine: https://www.google.com/maps/place/Ukraine/@48.2486332,26.694...

Re:Please, delete all new places since the start of war 23th... by endless1234 on Tuesday March 01, 2022 @06:52PM (#30521686)
It's the same in all countries with not-clear borders. Applies to eg Georgia, Serbia/Kosovo and India/Pakistan too.
Re:Please, delete all new places since the start of war 23th... by np- on Tuesday March 01, 2022 @08:51PM (#30522662)
Interesting, even Spain seems to not get a red outline (maybe because of Catalonia?)
Re:Please, delete all new places since the start of war 23th... by purjolok on Tuesday March 01, 2022 @10:46PM (#30523406)
It could be, but searching for Catalonia in Google maps explicitly indicates it's a part of Spain.

https://www.google.se/maps?q=catalunya

Another explanation would be the dispute with Morocco about Perejil Island:

https://www.google.se/maps?q=isla+perejil

Or even the dispute regarding Gibraltar with Britain.

Re:Please, delete all new places since the start of war 23th... by henriquemaia on Tuesday March 01, 2022 @11:24PM (#30523700)
Or the disputed border with Portugal at Olivença/Olivenza.

https://en.m.wikipedia.org/wiki/Olivenza

Re:Please, delete all new places since the start of war 23th... by baybal2 on Tuesday March 01, 2022 @06:29PM (#30521504)
If you go to the code, you will see it being deliberately set by data coming through AJAX.

Whomever did this...

Re:Please, delete all new places since the start of war 23th... by kkfx on Tuesday March 01, 2022 @06:58PM (#30521744)
Just for curiosity: did you mean that soldiers do have smartphones with them while on duty? If I were an officer I never accept personal proprietary devices with computing and communication abilities, it's simply absurd and crazy imagining soldiers on duty tracked by private companies just because they have a macro-spay in their pocket...
Re:Please, delete all new places since the start of war 23th... by modeless on Tuesday March 01, 2022 @07:28PM (#30521982)
There have been many cases of soldiers being tracked because of phones they were carrying. There was the widely publicized case of Strava revealing where some soldiers were stationed, and recently in Ukraine people noticed that Google Maps was showing "traffic jams" where Russian convoys were massing.

Militaries should probably prohibit personal smartphones completely. But I imagine such a prohibition would be a pretty big hit to morale and would also be very difficult to enforce, especially for non-combat areas where soldiers might not see the point.

Re:Please, delete all new places since the start of war 23th... by raxxorrax on Wednesday March 02, 2022 @04:05AM (#30525348)
We could also look into legislation where we finally make companies implement an easy private mode, where any data sharing is not permitted. Mobile apps behave far worse than desktop apps, although now that people notice they get away with it, the phenomenon also spreads on other systems.
Re:Please, delete all new places since the start of war 23th... by greyhair on Wednesday March 02, 2022 @08:25AM (#30527057)
I know someone that works in federal systems in a secure area, and you cannot take anything into the secure facility other than your physical being and the clothes you are wearing. Not even a wind up Timex watch. They have lockers outside the secure area where you deposit all your personal effects before entering the secured area. Everything goes into the locker. So it is a little odd that deployed troops are allowed to carry connected devices, other than military issued.
Re:Please, delete all new places since the start of war 23th... by rixed on Wednesday March 02, 2022 @12:19AM (#30524040)
IIRC they were explicitly banned from Iraq after that website emerged where soldiers were competing with the most gory and cruel pictures of casualties, and which disapeared when the more manageable abu graib story stole the show (anyone remember that website btw?)

https://www.abc.net.au/news/2004-05-23/rumsfeld-bans-camera-...

Re:Please, delete all new places since the start of war 23th... by alasdair_ on Tuesday March 01, 2022 @05:09PM (#30520734)
We ended up using Open Street Maps for SK data over Google. It worked very well.
Re:Please, delete all new places since the start of war 23th... by paganel on Tuesday March 01, 2022 @05:28PM (#30520925)
> And militaries all over the globe do use Google Maps extensively

ISIS and the other Islamist factions in the Syrian Civil War were also using it extensively when fighting the Syrian Government forces and when planning their suicide attacks, but because Assad was the bad guy no Google action was taken (like restricting GMaps access in the area).

Re:Please, delete all new places since the start of war 23th... by kuraudo on Tuesday March 01, 2022 @08:20PM (#30522449)
When I think of the rank hypocrisy that is used to justify decisions like these, it makes me glad that I don't work on these teams.
Re:Please, delete all new places since the start of war 23th... by k_sze on Tuesday March 01, 2022 @07:49PM (#30522168)
In the case of China, are you sure the offset is due to regulation and not simply some mismatch of geodetic datum?
Re:Please, delete all new places since the start of war 23th... by zacmps on Tuesday March 01, 2022 @08:44PM (#30522611)
Re:Please, delete all new places since the start of war 23th... by k_sze on Tuesday March 01, 2022 @11:29PM (#30523751)
Right, if you look under the "GPS shift problem" section, it does mention that it is due to the difference between the GCJ-02 and WGS-84 datums.

So it is not like the regulations are saying "you must shift the coordinates by this amount", which would be stupid. It's just that foreign map publishers have not obtained the license to use the correct datum for Mainland China, so they make do with another one.

Re:Please, delete all new places since the start of war 23th... by modeless on Tuesday March 01, 2022 @11:34PM (#30523784)
The "correct datum" is actually WGS-84 but deliberately obfuscated with a nonlinear transform. Yes, the regulations are explicitly saying "you must shift the coordinates by this amount".

Wikipedia: "GCJ-02 (colloquially Mars Coordinates, officially Chinese: 地形图非线性保密处理算法; lit. 'Topographic map non-linear confidentiality algorithm') is a geodetic datum formulated by the Chinese State Bureau of Surveying and Mapping and based on WGS-84. It uses an obfuscation algorithm which adds apparently random offsets to both the latitude and longitude, with the alleged goal of improving national security."

Re:Please, delete all new places since the start of war 23th... by k_sze on Wednesday March 02, 2022 @03:36AM (#30525184)
Ah, ok. I missed that section. Now things start to make sense.

What I don't completely understand, for two reasons, is why foreign map publishers would allow this pseudorandom offset to exist on their mapping apps:

1. The obfuscation algorithm has basically been cracked.

2. I don't think the Chinese gov can do much about foreign companies, except maybe by proxy, by pressuring the national trade liaisons or some such.

Re:Please, delete all new places since the start of war 23th... by modeless on Wednesday March 02, 2022 @10:46AM (#30528599)
Most multinational corporations have significant operations in China. Tech companies are essentially forced to unless they want to be locked out of the hardware side of the business.

Google famously left China, but still has offices there. It's impossible to ignore China if you want to develop the OS that runs on so many phones manufactured there (though I believe Google's own phones are built elsewhere). Apple obviously is completely reliant on China almost to a crazy degree. Microsoft caved to China on censorship to keep Bing from being blocked, they never left the way Google did. Facebook doesn't cooperate with China at all in their software products which are all banned, but they're increasingly getting into hardware and can't manufacture their hardware products without China.

Re:Please, delete all new places since the start of war 23th... by gbraad on Tuesday March 01, 2022 @08:28PM (#30522505)
It has been in existence for years now. Tested with multiple devices. It looks deliberate. Foreign apps are affected.

Amap works as expected.

Re:Please, delete all new places since the start of war 23th... by k_sze on Tuesday March 01, 2022 @11:30PM (#30523756)
Re:Please, delete all new places since the start of war 23th... by gbraad on Thursday March 03, 2022 @07:22AM (#30540001)
Thanks