News for hackers. Stuff that matters.

erikcw

Thanks for releasing this! How do you handle DDL queries? Are table changes synchronized to the Iceberg table automatically?

Also, I recently started looking into olake[0] to serve the same purpose. What would you say differentiates Streambed?

[0] https://github.com/datazip-inc/olake

How does Lakebase compare to Ducklake[0]?

[0] https://ducklake.select/

I’ve had very good experience with it last year. I used it at large scale with data that had been in iceberg previously and it worked flawlessly. It’s only improved since. Highly recommend.
Simon Willison wrote a good post about Dan Woods’ work on “Autoresearching Apple's "LLM in a Flash" to run Qwen 397B locally”.

[0] https://simonwillison.net/2026/Mar/18/llm-in-a-flash/

Re:Why DuckDB is my first choice for data processing on Friday January 16, 2026 @09:49PM (#46654802)
I use them both depending on which feels more natural for the task, often within the same project. The interop is easy and very high performance thanks to Apache Arrow: `df = duckdb.sql(sql).pl()` and `result = duckdb.sql("SELECT * FROM df")`.
Re:Show HN: Watch and Play Poker with LLMs on Saturday January 10, 2026 @07:01PM (#46571277)
Link to the lectures?
Data inlining is also currently limited to only the DuckDB catalog (ie it doesn't work with Postgres cataglogs)[0]. It's improving very quickly though and I'm sure this will be expanded soon.

[0] https://ducklake.select/docs/stable/duckdb/advanced_features...

Re:I built Foyer: a Rust hybrid cache that slashes S3 latency on Saturday September 27, 2025 @06:02PM (#45399704)
This looks really useful! Am I correct that there isn’t an S3 compatible API, just the “fetch” API?

Being able to set an S3 client’s endpoint to proxy traffic straight through this would be quite useful.

Re:BlackSheep: Fast ASGI web framework for Python on Wednesday December 18, 2024 @08:23PM (#42457369)
I’ve started using Granian[0] recently with good results.

[0] https://github.com/emmett-framework/granian

Re:Helium: Lighter Web Automation with Python on Wednesday December 11, 2024 @05:04PM (#42393511)
I've used SikuliX[0] in the past for similar purposes. Unfortunately the author hasn't had much time to maintain it recently.

[0] https://github.com/RaiMan/SikuliX1

Re:FCC rules AI-generated voices in robocalls illegal on Thursday February 08, 2024 @04:13PM (#39307783)
I've always wished that there was an option to whitelist certain area codes. I've had the same number for 20 years, and now live in a different part of the country. I get very little spam from local area codes -- but a ton spoofing my phone number's area code. Sending all calls all those calls to voicemail while continuing to ring for local would be the right balance (kids' school, doctors office, etc...).
Re:My cat water fountain comes with a spicy USB power adapter on Tuesday December 19, 2023 @11:50AM (#38697967)
I thought my ThermoWorks Signal had a dead/defective battery after trying to charge it on a standard USB power adapter. Device booted up and and functioned fine, except the battery wouldn't charge. Plugged it into the provided adapter and it started charging again.

Thanks for the PSA, I'll be sure to get that adapter off my kitchen counter right away!

Re:Ruff v0.1.0 on Monday October 16, 2023 @10:38PM (#37909846)
I’ve been meaning to find time to get ruff-lap working on Doom Emacs side by side with pyright. Is anyone who’s already managed to get it working willing to share their config?
Re:DuckDB 0.9.0 on Tuesday September 26, 2023 @02:18PM (#37663583)
How about the Relational API[0] or the new PySpark compatible API[1] added in this release?

[0] https://duckdb.org/docs/archive/0.8.1/api/python/relational_... [1] https://github.com/duckdb/duckdb/pull/8083

Re:Why We're Pulling Our Recommendation of Wyze Security Cameras on Wednesday September 20, 2023 @01:43PM (#37587246)
I'd love something like dd-wrt but for these cloud cameras. I have some Arlo cameras that I'd love to re-flash and run without the cloud service.
Re:Everyday Uses for PVC Water Pipe on Saturday September 16, 2023 @11:09AM (#37535452)
After stumbling upon this, I’ve been obsessively looking for an excuse to drill a well[0].

https://drillyourownwell.com/

Perhaps as a profit center to the tea industry. Most tea bags contain the grades of tea that can't be sold in the more expensive loose leaf form. Basically leaf fragments and dust. That material would otherwise be a waste product.
Re:Things you forgot because of React on Tuesday August 15, 2023 @11:11AM (#37134948)
I’ve been using it to great effect for the last year or so. It really is a breath of fresh air. In my case, I’m using a Django backend, but there are lots of successful folks using other backend stacks as well so choose what you know best.

The book is a really quick and easy read. It’s pretty eye opening how productive, and effective, htmx can be with so little magic.

https://hypermedia.systems/

Ideally you’d used Parquet or ORC if querying from Athena/Trino/Presto. Since they are columnar formats you will enjoy considerably faster queues and lower query costs for most query patterns other than “select *…” since the query engine can just retrieve the columns needed for your query instead of the entire row.
Re:Call GPT-3 from Terminal on Sunday February 12, 2023 @04:46PM (#34767401)
I was experimenting with the Warp terminal for the first time last week. It includes a similar feature. I was pretty impressed with how well it worked.

[0] https://docs.warp.dev/features/entry/ai-command-search#

I just tried polars for this first time this week. I ported a data pipeline from pandas and I was blown away by the performance yield. Function went from a 60 min runtime with pandas to ~1:30 in polars!

I’ve been using pandas for years and had no issues picking up the syntax. Can’t recommend giving it a try enough.

I recently inherited a codebase that uses Pony ORM[0]. Might be worth taking a look if you want your interactions to look as similar to vanilla python expressions as possible.

[0] https://ponyorm.org/

Older »