Re:French civil code now on GitHub
by nyandaber on Tuesday March 31, 2015 @07:05AM
(#9295442)
How does it feed the data to the repo? Is it parsing reports from the parliament? If yes, how smooth did the process go?
[ Parent
| on HN ]
It goes on each article on Legifrance, creates a JSON file with all the articles, which book/section they belong to, and for each article, tracks it's versions (they are dates). The crawler is in Go.
Then there is a python script that takes that JSON file, creates the .md files and runs the git commands in the shell.
Ultimately the sad thing is that I had to scrape this information. There were lots of pitfalls due to bad formatting and so on... Well, scraping.
It might not be necessary to scrap anything since this data was finally released as OpenData last year: https://www.data.gouv.fr/fr/datasets/legi-codes-lois-et-regl...