How Airbnb Built “Wall” to prevent data bugs

Re:How Airbnb Built “Wall” to prevent data bugs by hitekker on Friday May 20, 2022 @08:31PM (#31454197)

You seem to know what you're talking about. Ignorant question: do you think Dagster would work better as an orchestration/validation tool than AirBnB's Wall?

[ Parent | on HN ]

Re:How Airbnb Built “Wall” to prevent data bugs by SOLAR_FIELDS on Friday May 20, 2022 @08:54PM (#31454292)

I don’t know much about Dagster but it does not look like they have a validation tool equivalent to Wall, which requires Airflow. So you would not get validation with Dagster unless you brought it yourself.

[ Parent | on HN ]