budoupalmer

I've been using databases that offer strong consistencies, and only recently came across the concept of weak consistency, or eventual consistency. But there seems to be too many varieties of weak consistencies and it's so hard to figure out the nuances and know whether my app is safe under a certain consistency model. This line of research seems to help with that, but oftentimes applications interact with DB in different patterns, and I am not sure if you can get these all covered..

I've been using Airflow for my data pipelines and I've had a lot of issues with it as well. This blog post makes some good points about how it doesn't care about data and is not built for fast iteration. Has anyone else had similar experiences?