News for hackers. Stuff that matters.
Re:Bad Data and Data Engineering: Dissecting Google Play Mus... by otter-in-a-suit on Sunday December 26, 2021 @08:36PM (#29698127)
makefiles in general are something that I quite frankly never figured people use with anything (forgive me for saying it) but "old-school C"... but I started using them earlier this year (the linked article is from Feb) after finding a makefile in a Python GitHub repo. I've since created one for most of my Python and go repositories and they've been a great tool. It has, however, not occurred to me to use them in place of actual pipelines (as the linked comments suggest), so I'll definitely try this soon, thanks!

That being said, a lot of what I do on my blog is stuff I don't get to do at work - Airflow being one of those things that has been "abstracted away from me" for too long...

There are no comments on this comment yet.