boxer_shorts
Re:Catching silent data loss using BigQuery's native ML and Write API
on Thursday March 12, 2026 @07:06PM (#47358497)
We needed a way to detect ingestion anomalies across 200+ microservices without building a separate ML stack. It turns out BigQuery already tracks every row written in WRITE_API_TIMELINE, and its built-in AI.DETECT_ANOMALIES (powered by Google’s TimesFM) can handle the detection.
Re:Using an ETL framework vs. writing yet another ETL script
on Saturday December 18, 2021 @09:54AM (#29604877)
I think before jumping onto no/low-code tools you should read the post by Brandon Byars just to get a complementary view on integration
https://martinfowler.com/articles/cant-buy-integration.html
Re:Using an ETL framework vs. writing yet another ETL script
on Saturday December 18, 2021 @09:25AM (#29604672)
I think it is great stuff you are building, especially for data integration of external sources that don’t offers webhooks or other pub/sub integration options. But is Airbyte really Open Source? I’m not questioning the reasons for moving to a source available license due to how AWS treated open source, but I think it is a bit of false marketing of Airbyte referring to it as open source. Sure, some pieces are MIT but the core is Elastic License 2.0 from what I can see. https://airbyte.io/blog/a-new-license-to-future-proof-the-co...