Git scraping: track changes over time by scraping to a Git repository

Re:Git scraping: track changes over time by scraping to a Gi... by RvdV on Friday October 09, 2020 @03:14PM (#24733362)

Wow, that's a cool idea! I wonder, how do you handle bad responses (e.g. HTTP 400/500) from the server? It might mess up the logs twice if it's committed...

[ Parent | on HN ]

Re:Git scraping: track changes over time by scraping to a Gi... by simonw on Friday October 09, 2020 @03:14PM (#24733368)

I think if that happens `curl` returns an error status which kills the actions script before it gets to the commit - so you get an error message on the action but nothing is committed to the repo.

[ Parent | on HN ]

Re:Git scraping: track changes over time by scraping to a Gi... by RvdV on Friday October 09, 2020 @03:18PM (#24733398)

Ah, that makes sense, thanks!

[ Parent | on HN ]