News for hackers. Stuff that matters.

Binomial-Dist

Re:Stream Processing with DuckDB/Polars? on Sunday December 15, 2024 @09:58PM (#42427637)
Thanks, I'll take a look!

Stream Processing with DuckDB/Polars?

I'm looking to do relatively simple streaming transformations on CDC data coming from Postgres. Dealing with a relatively small amount of data (1Ks to 10Ks of rows per minute, in most situations) making something like Flink + Kafka seem way overkill. Could engineer something custom that just builds on Postgres logical replication but would like something that just cleanly plugs in with DuckDB...

( Read More... | 3 comments | 3 points | on HN )
Awesome! Huge problem in a lot of Python codebases, and hard to get around this problem without trying to go all in on type-safety. Even so, you don't get granular control like this.