Re:How ProPublica Illinois Uses GNU Make to Load Data
by chemicalcrux on Wednesday July 11, 2018 @06:02PM
(#17510622)
I did something like this a few years ago! I needed to do a bunch of transformations and measurements of data that came in on a regular basis. Make was a perfect fit - I could test the whole process with a single command, cleaning either just the result data, or nuking everything to make sure it pulled stuff in properly.
I spent some time trying to write my own processing system in Python before realizing this was a familiar task...
I spent some time trying to write my own processing system in Python before realizing this was a familiar task...