metaodi
Only since I use tig I understand how to commit hunks. It's super easy to split the changes of a file into different commits that make sense. With most other clients this is either cumbersome or not possible. So your forced to always commit all changes of a file in one commit.
I guess it just really works great for my workflow and the way I think about my repositories/commits.
https://github.com/openZH/covid_19
There is a common runner script and a matrix configuration to run this script for each Swiss canton (see https://github.com/openZH/covid_19/blob/master/.github/workf...).
The scrapers report errors to our slack channel and we even have workflows to deactivate/re-activate a single scraper, since it's common that one fails and we need to fix it (to stop spamming the slack channel with error messages).
They currently have data from Barcelona, Bristol, Clark County, Edmonton, Frankfurt, Las Vegas, London, Melbourne, New York, Paris, Portland, Rostock, San Francisco, Santa Monica, Seattle, Vancouver, Washington DC, Vienna and Zurich.
If anyone is interested, the API is here: openerz.herokuapp.com and the city is Zurich, Switzerland.
CKAN is currently the de-facto standard for these kind of portals, so being able to query the CKAN Action API enables to gather metadata from portals all over the world.
Some portals even have an API directly to their primary data (e.g. exposing a CSV as a querable JSON REST API), in CKAN this is called "DataStore". And this kind of data might be something you want to integrate. I can think of a number of datasets that could be interesting, e.g. schedule of garbage collection, public transport timetable or measurements from public weather stations.
Different portals have different data available. I'm from Switzerland and I know these datasets are available here. Is there a geograhical region you want to cover/not cover or it doesn't matter?