News for hackers. Stuff that matters.
Re:DuckDB 0.9.0 by carlopi on Tuesday September 26, 2023 @02:01PM (#37663308)
I just discovered Hacker News offers a JSON API, ducking awesome, if only there was a nice tool to crunch data as JSON files...

I think I have just found out yet another great DuckDB-weekend project!

Re:DuckDB 0.9.0 by tylerhannan on Tuesday September 26, 2023 @02:30PM (#37663758)
It's definitely a fun dataset to explore.

Dale from ClickHouse wrote a pretty extensive blog series on the Hacker News dataset, ingest approach, some queries of interest...

Could be a good bit of reading alongside the project?

https://clickhouse.com/blog/getting-data-into-clickhouse-par...

Re:DuckDB 0.9.0 by carlopi on Tuesday September 26, 2023 @02:45PM (#37663964)
Thanks, cool read, I took a couple of ideas, will see where we land.
Re:DuckDB 0.9.0 by carlopi on Tuesday September 26, 2023 @05:21PM (#37665970)
Btw, it's already happening:

Go to https://shell.duckdb.org, and type FROM 'https://hacker-news.firebaseio.com/v0/item/37663308.json';

Querying hacker news, from a browser tab (passing through a bunch of database and Web technology that make it possible for DuckDB to be executed within a browser tab)

Re:DuckDB 0.9.0 by ddanieltan on Wednesday September 27, 2023 @08:57AM (#37673965)
woah! Didn't know this existed https://shell.duckdb.org, it's pretty cool!