Re:Governments on GitHub
by danthelion on Friday June 09, 2023 @10:38AM
(#36258484)
This GitHub page was the starting point: https://government.github.com/community
[ Parent
| on HN ]
From what I gather from this page it seems organisations need to be added by the community or organisation members. I know a few organisations that aren't on that list for my country like https://github.com/GouvernementFR, https://github.com/DISIC, https://github.com/ANSSI-FR and https://github.com/ansforge. No promises but I might make a PR tonight on the page you mentioned.
Re:Governments on GitHub
by danthelion on Friday June 09, 2023 @11:04AM
(#36258907)
That would be great, scraping that site is the entrypoint of my data pipeline!
Just out of curiosity about how people actually access stuff, does scraping mean (as I'd expect I guess) the rendered website, or consuming the data files https://github.com/github/government.github.com/tree/gh-page... ?
Querying wikidata may also be useful https://github.com/github/government.github.com/issues/877
Re:Governments on GitHub
by danthelion on Friday June 09, 2023 @01:07PM
(#36260817)
I have missed the data file entirely and just extracted all the entities from the rendered website, then enriched all the repositories with some extra info through the API (still ingesting some data for a few repos, hitting the API limit frequently).
The goal is to have a deeper level view of public government orgs, including a more granular view of contributors and how they interact with code.
Great idea about wikidata! That's another data rabbit-hole to climb down into.
Even from this page there appears to be a fair bit missing. E.g. one of the biggest UK gov orgs is @alphagov (~1.6k repos), which I can't seem to see on your dash?