palewire

The site includes a CSV of everything I found. You could hand that to Claude Code and ask it to pull down the WARCs

Please give archive.org all the credit

I fixed that:

https://fivethirtyeightindex.com/graphics/ https://fivethirtyeightindex.com/illustrations/

FWIW, the site now indexes 13,000 graphics and 3,000 illustrations, which I clawed out of the Wayback Machine's HTML and preserved separately in an archive.org collection.

https://fivethirtyeightindex.com/graphics/ https://fivethirtyeightindex.com/illustrations/

The archive.org backend is at https://archive.org/details/fivethirtyeight-collection and will almost certainly outlive my site.

Thanks. I'm glad you found it interesting!

Today I'm happy to release "First Basemap," a free tutorial that shares one of our most valuable recent innovations at Reuters.

It's at https://palewi.re/docs/first-basemap/

Follow the step-by-step guide and you'll learn how to create a shockingly fast and virtually free interactive map of the world.

This type of map is often called a basemap because it provides the foundation for displaying data layers like weather conditions, election results, demographics or the location of newsworthy events.

Until recently, creating a basemap was a difficult task that required specialized skills and expensive servers. Rather than take on the challenge, many organizations chose to pay for commercial mapping services, which can be costly for applications that draw a lot of traffic.

Then open-source software changed the equation.

Partnering with Scott Reinhard, we used Protomaps, OpenStreetMap, MapLibre and other free tools to craft a stylized version that will serve as the foundation for all Reuters mapping projects going forward. Casey Miller has already used it to track hurricane activity and share the latest forecast with our readers.

Scott has written a detailed explanation of his design process on his site. While the fonts, styles and other customizations he tailored for Reuters are copyrighted, his underlying techniques are free for anyone to adapt.

That's at https://scottreinhardmaps.com/blogs/custom-mapping-projects/...

One challenge in creating a basemap is the size of the massive database containing almost every border, road, building and natural feature on the planet.

"First Basemap" walks you through how you can use inexpensive cloud computing tools to solve the problem. Follow along and you'll have a basemap of your own for less than $10. Where you go from there is up to you.

Has anyone else on HN had experience rolling their own basemap? I'd love to hear how you're making it happen, what's working and what isn't.

I edited this poll for Reuters, which was released today with this story.

https://www.reuters.com/world/us/americans-worry-musks-campa...

If you have any questions or critique, let's hear it.

The 392 news organizations listed at this URL have instructed OpenAI’s GPTBot to not scan their sites, according to a continual survey of 1,119 online publishers conducted by the homepages.news archive. That amounts to 35.0% of the total.

The artificial intelligence company has suggested it will not train future editions of ChatGPT using sites that opt out of GPTBot crawls via the robots.txt convention.

Our archiving system gathers each news organization’s robots.txt file twice per day. This page automatically updates with the latest results.

The sites we track are a best effort to cover a broad cross-section of news publishing.

That said, the sample is not comprehensive. It's also primarily focused on the English language market.

There's a state database compiled by CHP called SWITRS that tracks traffic accidents. You can find it here. http://iswitrs.chp.ca.gov/Reports/jsp/userLogin.jsp

We don't call it out by name in the story, but it's the kind of existing government system that could be expanded to provide a better, official count of street racing deaths.

Our Los Angeles Times team has mined SWITRS in the past for other stories, like these:

http://graphics.latimes.com/la-pedestrians/

http://graphics.latimes.com/la-bike-hit-and-runs/

Thanks!

If you're a Python person, I'd love to hear what you think of how I structured the notebook.

There isn't a set style for writing these and I've been experimenting with different forms lately.

In this case, I pushed back some of the bigger code chunks into separate Python modules.

I appreciate your effort to bring some context to the analysis.

However, as we unpack in the story, our total is likely an undercount due to the problems in tracking street racing related crashes.

I worked on the data analysis for this story, which was published at a Jupyter Notebook of Python code.

https://github.com/datadesk/street-racing-analysis/blob/mast...

If you have any questions, shoot.

I'm the author of this post. Glad to see it's been submitted here. If you have any questions, please fire away.

Thanks for the tip. This is something I was unaware of.

I hadn't considered that. It only accepts CSVs, not Excel files, right now. If you can provide an example of a dangerous file we can try testing against it.

I'm one of the organizers of the California Civic Data Coalition and this event.

If you have any questions about our work, or the state of California's crippled database tracking money in state politics we're aiming to improve please fire away.

I work at The Times on the team behind these stories and FYI we did a whole previous investigation focused on just that

http://www.latimes.com/projects/la-fi-electricity-capacity/

Thanks for passing this along. It's very interesting. I just gave it a go with a hefty SQL import to test its power. My database connection string to Amazon RDS, which works locally on my computer, failed. Any idea why?