Re:Introduction to Simple Workflow Service (SWF)
by teraku on Wednesday July 15, 2020 @10:30AM
(#23845682)
This looks awesome, but I don't understand what this has that airflow, prefect or luigi don't have?
[ Parent
| on HN ]
Re:Introduction to Simple Workflow Service (SWF)
by bbri06 on Wednesday July 15, 2020 @12:30PM
(#23847588)
Scale, interactivity, and durability are certainly part of this discussion. You can use Cadence/Temporal for purposes you just really couldn't use Airflow for. For instance, you could implement this entire actor-based auction example from Akka with Cadence/Temporal https://doc.akka.io/docs/akka-enhancements/current/persisten... There is absolutely no way you could do that with Airflow.
To understand why Cadence is so useful, you have to go a bit beyond the traditional ETL scheduling usages IMO.
Re:Introduction to Simple Workflow Service (SWF)
by ttsda on Wednesday July 15, 2020 @11:04AM
(#23846198)
In SWF/Durable Functions/Cadence/Temporal, The entire workflow is defined as (deterministic) code, which is orchestrated by the engine.
Re:Introduction to Simple Workflow Service (SWF)
by teraku on Wednesday July 15, 2020 @11:16AM
(#23846379)
As as opposed to... having undeterministic code?
Workflow as code is also the theme of airflow, luigi and prefect.
Re:Introduction to Simple Workflow Service (SWF)
by firdaus on Wednesday July 15, 2020 @11:25AM
(#23846587)
With Temporal/Cadence you write (mostly) plain code to implement your business logic rather than using code to define DAGs.
This discussion has more on Airflow vs Cadence: https://news.ycombinator.com/item?id=19732447