News for hackers. Stuff that matters.

A comment on Show HN: Arc, an open-source Databricks alternative. Parent comment

Re:Show HN: Arc, an open-source Databricks alternative by tuyguntn on Thursday March 25, 2021 @06:54AM (#26578609)
> repeatable in that if a job is executed multiple times it will produce the same result

can you please elaborate more on this statement, does it mean you dump the data first time job is executed? Because if data is evolving, at some point execution should produce different results

[ Parent | on HN ]
Re:Show HN: Arc, an open-source Databricks alternative by seddonm1 on Thursday March 25, 2021 @04:04PM (#26584731)
The better statement would be that this facilitates the development of idempotent jobs and aims to minimise side-effects.
[ Parent | on HN ]