News for hackers. Stuff that matters.
Re:PostgreSQL 17 by nojvek on Thursday September 26, 2024 @05:12PM (#41663448)
I wish postgres supports parquet file imports and exports. COPY command with csv is really slooooooooow. Even BINARY is quite slow and bandwidth heavy.

I wonder how open postgres is and what kind of pull requests postgres team considers? I'd like to learn how to contribute to PG in baby steps and eventually get to a place where I could contribute substantial features.

Re:PostgreSQL 17 by ioltas on Thursday September 26, 2024 @05:57PM (#41663940)
There has been a patch to extend the COPY code with pluggable APIs, adding callbacks at start, end, and for each row processed: https://commitfest.postgresql.org/49/4681/.

I'd guess that this may fit your purpose to add a custom format without having to fork upstream.

Re:PostgreSQL 17 by ssfak on Friday September 27, 2024 @05:00AM (#41667888)
Using the pg_duckdb[1] is an option, if you can install extensions on your setup.

[1]. https://github.com/duckdb/pg_duckdb