Pg_parquet: An Extension to Connect Postgres and Parquet

Re:Pg_parquet: An Extension to Connect Postgres and Parquet by brinox on Friday October 18, 2024 @04:00AM (#41877261)

I was just wondering if pg_parquet could be combined with pg_azure_storage to write Parquet files to Azure Storage.

I had problems with pg_azure_storage in the past, because the roles pg_read_server_files and pg_write_server_files are unassignable on Azure PostgreSQL databases which makes the use of `COPY {FROM,TO}` impossible.

[ Parent | on HN ]

Re:Pg_parquet: An Extension to Connect Postgres and Parquet by mslot on Friday October 18, 2024 @05:10AM (#41877608)

Azure is not supported as a backend in pg_parquet right now, but shouldn't be hard to add (contributions welcome!)

https://github.com/CrunchyData/pg_parquet

It would not be safe to let any user access object storage. Therefore, pg_parquet has two roles called parquet_object_store_read and parquet_object_store_write that give permission to COPY FROM/TO object storage (but not local file system).

In pg_azure_storage there is a comparable azure_storage_admin role that needs to be granted to users that need Azure Blob Storage permission.

[ Parent | on HN ]