News for hackers. Stuff that matters.
Re:Data Engineering Patterns with Apache Airflow [video] by sejtnjir on Wednesday August 29, 2018 @11:07AM (#17868784)
Adopting Airflow over cron was a huge leap for the analytics company I worked for. I think the biggest win was making the complex net of dependent batch operations explicit. That logic lived inside the head of the lead dev before that point. This allowed management to reason about how new functionality effected operational complexity, which would have been unimaginable before.

There are no comments on this comment yet.