News for hackers. Stuff that matters.

A comment on Show HN: Pg_analytica – Speed up queries by exporting tables to columnar format. Parent comment

Re:Show HN: Pg_analytica – Speed up queries by exporting tab... by wanderinglight on Saturday June 08, 2024 @01:39PM (#40619105)
This is definitely something I intend to fix.

My initial intent was to use duckdb for fast vectored query execution but I wasn't able to create a planner / execution hook that uses duckdb internally. Will definitely checkout pg_analytics / Datafusion to see if the same can be integrated here as well. Thanks for the pointers.

[ Parent | on HN ]
Re:Show HN: Pg_analytica – Speed up queries by exporting tab... by mildbyte on Saturday June 08, 2024 @01:42PM (#40619132)
Have you seen duckdb_fdw (https://github.com/alitrack/duckdb_fdw)? IIRC it's built based on sqlite_fdw, but points the outbound queries to DuckDB instead of SQLite, and it does handle running aggregations inside of DuckDB. Could be useful.
[ Parent | on HN ]
Re:Show HN: Pg_analytica – Speed up queries by exporting tab... by wanderinglight on Saturday June 08, 2024 @02:32PM (#40619401)
This is great, thank so much! I'll see if I can I can integrate this and how it compares to parquet_fdw.
[ Parent | on HN ]