News for hackers. Stuff that matters.

yellowbkpk

Re:Make your first edit to OpenStreetMap on Sunday September 13, 2026 @12:30PM (#49685748)
Tesla routing uses a mix of its own data and TomTom, which uses OSM. As a point of reference, I fixed a road name in OSM ~3 years ago and flagged it through TomTom's site directly ~2 years ago and the Tesla map hasn't fixed it yet.
Re:Starship V3 on Tuesday May 12, 2026 @11:52PM (#48117591)
Check out this video that goes into a very deep technical explanation about how the satellites can be used as a Synthetic Aperature Radar to build a realtime representation of the entire globe at meters of resolution: https://youtube.com/watch?v=jbp3kdJZ1_A
Re:Pixel 10 Phones on Wednesday August 20, 2025 @04:52PM (#44966328)
It's interesting that this feels awkward to you, because when apps don't function this way it feels broken and odd to me. When I tap a PDF attachment in an email I expect the back button to go back to the email I was just viewing, not the list of PDFs on my phone. If I wanted to view all the PDFs on my device, I would start at the PDF viewer and tap into PDFs from there.

I wonder what experience made this feel more awkward for you (and conversely, why it feels more natural for me). What a weird/complex world we live in!

Nope, unfortunately Royal Post claims copyright on all of the address data and won't release it unless you pay.
I love seeing all the great comments in here about the different APIs and the features they do and don't offer, but I want to point out that the underlying data for addresses is incredibly hard to find. The reason the commercial geocoding providers won't let you store their data is because they're worried you'll store enough data to build your own geocoder.

To help with this, a group of folks (including me) started OpenAddresses (https://openaddresses.io/ and https://github.com/openaddresses/openaddresses/) with the goal of finding every open address dataset in the world. We produce a zip file with 100M's of addresses that several of the APIs mentioned in this thread use as a major part of their dataset. We've been going for well over 10 years now, but it would be great to have more eyes looking for more address sources. Check us out!

Re:Stop Using Zip Codes for Geospatial Analysis (2019) on Friday February 07, 2025 @04:14PM (#42977557)
There is no "official US Gov list of ZIP codes". They come from the US Postal Service, and those aren't published for free.
It's public and private. It still has to make money to survive because it doesn't get much in the way of tax money.

https://www.uspsoig.gov/focus-areas/did-you-know/postal-serv...

It boils down to the fact that the United States does not have (public domain) knowledge of every address in the country.

The USPS knows about deliverable addresses but won't give that information to the federal government because then it'd be public domain and they would lose several of their primary data moats (Zipcodes, addresses, delivery routes, for example). The Census has very complete knowledge of every address, but won't give it up because it's illegal (see Title 13 of the US Code). There is an ongoing attempt by the DOT to collect a National Address Database (https://www.transportation.gov/gis/national-address-database) by collecting information from the address assigning authorities (usually county governments), but it's incomplete and unlikely to ever be complete because of holdout/underfunded local governments.

There are several address datasets that are private (Google has a fairly complete one, FedEx/UPS probably have the most complete, TomTom, CostQuest, etc.). I started https://openaddresses.io/ to try and collect them (NAD is based off this idea) into an open-licensed dataset.

The broadband companies have records that say "this address is connected to this network, which could theoretically have this service level", but (a) they won't/can't tell you where they think the address is and (b) won't spend the time to match their address string format with the government's address because both are private data.

Finally, without the address -> location data, even if we could get broadband providers to tell us what service is available at each address, we couldn't put that service level on a map because we don't know where the address is.

----

The Markup published some work in 2022 where they used OpenAddresses to use ISP's own tools to gather per-address service offerings and put them on a map. This is what the FCC's broadband map should be doing, but can't for the above (and political) reasons: https://themarkup.org/show-your-work/2022/10/19/how-we-uncov...

Re:Docker Desktop no longer free for large companies on Tuesday August 31, 2021 @03:43PM (#28372591)
At least Facebook, Apple, Amazon, Netflix, Google, Microsoft.
Re:Amtrak’s Empire Builder: The Train That Deserves Better on Tuesday September 29, 2020 @10:39AM (#24628353)
Interestingly, it wasn't the Obama administration that tried to build the high speed rail. It was the Republican governor of Wisconsin (Tommy Thompson) that pushed for it. Scott Walker used it as a wedge to split the electorate and win the election. Wisconsin Public Radio did a great podcast about it here: https://www.wpr.org/derailed/wisconsins-high-speed-rail-saga...
The Toner style from Stamen has several different layers that you can use to accomplish what you're talking about:

- Hybrid does exactly what you're looking for: http://maps.stamen.com/toner-hybrid/#12/37.7706/-122.3782

But they also break that down into labels and lines:

- Labels: http://maps.stamen.com/toner-labels/#12/37.7706/-122.3782

- Lines: http://maps.stamen.com/toner-lines/#12/37.7706/-122.3782

Their Terrain style has a similar separation:

- Lines: http://maps.stamen.com/terrain-lines/#12/37.7706/-122.3782

- Labels: http://maps.stamen.com/terrain-labels/#12/37.7706/-122.3782

- Background: http://maps.stamen.com/terrain-background/#12/37.7706/-122.3...

Thank you for sharing this. One small typo or formatting error: The last line is missing a ~/ and should be: `sudo chown -R nobody:nobody ~/.zoomus`
Take a look at the AWS Elevation Tiles: https://registry.opendata.aws/terrain-tiles/

While at Mapzen (RIP), I helped generate these from a wide selection of open elevation data sources.

OSM editors are prevented from using Google Maps because OSM prefers that we have explicit permission to use data sources. Since we don't have explicit permission to use Google Maps, we can't use it.

Separately, Google Maps has a terms of use that prevent reuse of Google Maps data. You agree to those terms when visiting Google Maps or using Google Maps API.

You wouldn't be breaking copyright law when copying from Google Maps to OSM, you'd be breaking the terms of use contract with Google and community Norma expectations in OSM.

Re:AWS Public Datasets on Sunday March 25, 2018 @11:14PM (#16676349)
As someone who has spent a considerable amount of time on data that has ended up on this page, I think the fact that the list hasn't grown says more about the priorities of other companies than of AWS. Amazon doesn't (yet) have time to build and maintain these datasets themselves: they work with others to build and maintain it and then fund the storage and transmission fees.

I helped build the Terrain Tiles dataset as part of Mapzen, which recently shut down. The OpenStreetMap data exists on the AWS Public Datasets page because it's useful to Humanitarian OpenStreetMap Team. If you're able to convince your company to generate and work with a public dataset, consider reaching out to the AWS and Google public datasets teams to get it hosted and publicized.

Re:OpenStreetMap Is in Trouble on Saturday February 17, 2018 @10:45AM (#16401147)
Hello. I am the creator of alltheplaces and Max is absolutely correct. Alltheplaces is a bunch of scrapers right now because it was the fastest way to get the data, but if you have data in a machine readable format already then I don't have to scrape it. I can just download your data file and distribute it to whomever wants to use it (people interested in importing to OSM, geocoders/search engines, etc.).
Re:Earth on AWS – Open geospatial data on Monday November 06, 2017 @09:40PM (#15640689)
It'd be great to have this data in Internet Archive. If you check out our GitHub repo [0] you can see where we coordinate finding data sources. The data I download gets composited into tiles for display on maps, so we're updating ~4 billion objects in S3.

The source data is probably the better thing to include in IA, and the GitHub repo is probably the best place to find how to mirror it. If you've got time to spend on it, you might post an issue in there and I can help point you in the right direction.

[0] https://github.com/tilezen/joerd/issues?q=is%3Aissue+is%3Aop...

Re:Earth on AWS – Open geospatial data on Monday November 06, 2017 @10:46AM (#15636246)
I want to give another example: I'm currently updating the Terrain Tiles dataset [0] and a very significant portion of my time was spent working around terrible government data download websites or incompatible distribution formats.

For example, the UK Government flew some excellent LIDAR data missions generating a very high resolution elevation model for most of the country and then put it behind a terrible website where you have to click 3 or 4 times to get a small piece of the data. After a couple hours I built a script to download all the pieces and put them back together into usable sized downloads [1]. Mexico's INEGI has a similar situation, so I had to dig through that to build a scraper [2]. USGS's EarthExplorer uses a terrible shopping cart metaphor for download [3].

All that is to say that the interesting piece with Earth on AWS is that this is public data that smart people are putting in a more easily accessible place for mass consumption and AWS is footing the bill. In return AWS is getting people more interested in AWS products and a set of customers that are more knowledgeable about how to process data "in the cloud".

[0] https://aws.amazon.com/public-datasets/terrain/

[1] https://github.com/iandees/uk-lidar

[2] https://github.com/iandees/mx-lidar

[3] https://earthexplorer.usgs.gov/

Re:Building an API on open data on Thursday August 03, 2017 @09:34PM (#14925660)
Check out OpenAddresses: we're trying to solve the address/location data aggregation problem so you don't have to. We do all the data scraping and collating for you so you can work on making a geocoder. https://openaddresses.io/
All addresses are pretty hard for computers to understand, so the people building the software to make them understand (geocoders) usually make them work for the most 'in-demand' address formats. Just like every other bit of software, finding the special cases and figuring out how to understand them is tricky.

http://www.columbia.edu/~fdc/postal/ is a pretty good overview of most of the postal addressing systems around the world.

US Census can't really work with anyone when it comes to their data. They take their responsibilities under Title 13 [0] (which prohibits them from sharing information they collect) very seriously.

They're trying various options to share some limited data (like address data) [1], but haven't gotten very far. They've done some work on "Community TIGER" [2], which aims to give validation information back to local governments for geographic data, but not the improvements that Census generates as part of the decennial census.

The US Postal Service has no motive to share with the Census Bureau. For one thing, the USPS makes all of its money selling limited access to its address list to advertisers. Additionally, the USPS's address list (or delivery points) doesn't necessarily correspond with people and where they live.

PS: I'm interested in this sort of thing because I help run OpenAddresses [3], a community-built list of authoritative address data sources from around the world. There's a lot of data out there!

[0] https://www.law.cornell.edu/uscode/text/13/9 [1] https://fcw.com/articles/2011/09/14/census-bureau-title-13.a... [2] https://www2.census.gov/geo/pdfs/gssi/Community_TIGER.pdf [3] https://openaddresses.io/

It's a couple completely new imagery layers. Digital Globe has lots of imagery and these layers appear to have different imagery for lots of the areas I've checked. Digital Globe is offering these two layers to OSM editors to improve OpenStreetMap, and it's great.
As a long time contributor to OpenStreetMap, this is hugely appreciated. Getting direct support from Digital Globe is important and hopefully helps signal that OSM is worthy of people's time and contributions.
Re:Introducing Yelp's GraphQL API on Wednesday May 03, 2017 @08:09PM (#14261392)
Mapcode doesn't identify a place/business/venue, it identifies a location on earth. If the building moves or a business changes offices then the Mapcode changes, too.

Take a look at Mapzen's gazetteer project "Whose on First". It aims to generate a unique identifier (and store with it concordances for other venue IDs, opening hours, images, etc.) for every venue on earth and is designed to handle situations where a business is started, changes location, or closes.

https://whosonfirst.mapzen.com/

(Disclaimer: I work for Mapzen)

When I helped run a college radio station as a student, one if the things I had to check on was the Emergency Alert System (EAS). It's the system that cuts into your broadcast and allows emergency personnel to transmit information over TV and radio.

Maybe it was specific to our setup, but our station was assigned two other stations to listen to for EAS alert tones. If the box heard the tones it would flip a relay and broadcast the audio from the station it heard the tones on. If you drove by the station with and FM transmitter and replayed the EAS tones, you could transmit whatever you want. I imagine the stronger FM stations have a bit more security than we did, but it always striked me as a rather vulnerable system.

There's a beep, an LED blip, and once it's docked you cannot remove it from the rack. There's lots of things wrong with the system, but returning bikes is pretty darn low on the list.
I was on an LHR-IAD flight earlier this week that was 2 or 3 in line for takeoff and had to taxi back to the gate so they could remove something from the hold. From the conversations I overheard it was a phone that had to be removed from someone's checked baggage.
Re:Amazon has made its first drone delivery to an actual customer on Wednesday December 14, 2016 @12:49PM (#13177992)
It depends a lot on the wind and the size/shape of the propellers. When I fly my DJI UAVs up near 400 feet above ground on a zero-wind day it's very easy to hear when I'm outside. When they get to be ~500 feet away it's much harder to hear. I've never been inside while flying, but my wife says she can't hear it when she's inside. On a breezy day, the wind through the trees covers most of the noise while I'm outside, but the variation in the noise when the flight computer is compensating for wind makes it a little easier to pick out.

Bottom line: you'll probably be able to hear these large Amazon UAVs when you're outdoors and when they're within 500 feet of you.

I spent Memorial Day weekend working on Python/OpenCV traffic counter that uses similar motion detection techniques. I tried to explain how it works in the readme on the GitHub repository:

https://github.com/iandees/speedtrack

Older »