Ask HN: Why do message queue-based architectures seem less popular now?

Re:Ask HN: Why do message queue-based architectures seem les... by csunbird on Wednesday June 19, 2024 @05:39AM (#40726574)

This is exactly what we do, but with Spark instead. We develop the functions locally in a package and call necessary functions for the job notebooks, and the job notebooks are very minimalistic because of this

[ Parent | on HN ]

Re:Ask HN: Why do message queue-based architectures seem les... by appplication on Wednesday June 19, 2024 @09:10AM (#40727959)

Spark-via-Airflow is also the context we use this, glad of see the pattern also works for you.

[ Parent | on HN ]