News for hackers. Stuff that matters.
Re:MTA Open Data Challenge by pjot on Friday September 27, 2024 @08:04PM (#41676724)
This is super true. For my city’s portal as well. I’ve found one way around this by versioning the dataset - that is, committing the diffs in git. Credit to Simon Willison’s git-scraping technique.

I do this with my power company’s outage map: https://github.com/patricktrainer/entergy-outages

67k commits!

https://simonwillison.net/2020/Oct/9/git-scraping/

Re:MTA Open Data Challenge by chaps on Saturday September 28, 2024 @12:23AM (#41677845)
That's a really freaking neat trick. Thanks!