News for hackers. Stuff that matters.

A comment on Mara: A lightweight ETL framework, halfway between plain scripts and Airflow. Parent comment

Re:Mara: A lightweight ETL framework, halfway between plain ... by artwr on Wednesday May 09, 2018 @12:19PM (#17031061)
With a little bit of work you could probably trigger tasks on a Windows Machine, in particular if the work you need to do is mostly script and/or SQL based. The main limit is that Gunicorn for the Airflow webserver is not currently compatible with Windows, but the scheduler should work fine. I believe it might be able to run in the Windows Subsystem for Linux, but I don't think anyone has tested it as of yet. (Source: I am an Apache Airflow committer)
[ Parent | on HN ]
Re:Mara: A lightweight ETL framework, halfway between plain ... by leblancfg on Wednesday May 09, 2018 @03:19PM (#17032974)
Thanks! To be fair, I was looking at it from a single-user perspective, and was optimizing for:

    time it takes to setup and move my ETL to Airflow + time I will save in the future by using the framework
vs

    time I will spend fixing and maintaining my already-existing ETL scripts
so I dropped the notion after I hit the first major snag. But I should put a reminder to take a look back at it in a few months!
[ Parent | on HN ]