News for hackers. Stuff that matters.
Re:We saved millions in SSD costs by upgrading our filesystem by ddlutz on Tuesday November 09, 2021 @01:01PM (#29165020)
I wonder how well Postgres is up to the task of analytical queries? Most people use Postgres for OLTP, maybe they are running some version of it that uses a column store?
Re:We saved millions in SSD costs by upgrading our filesystem by jhk727 on Tuesday November 09, 2021 @02:32PM (#29166318)
Postgres is not designed for OLAP, but you can push it a lot farther than one would expect with the correct schema and indexing strategy. See https://heap.io/blog/running-10-million-postgresql-indexes-i... for a little more detail about how we schematize for distributed OLAP queries on Postgres at scale.
Re:We saved millions in SSD costs by upgrading our filesystem by __s on Tuesday November 09, 2021 @01:02PM (#29165041)
They use Citus: https://www.citusdata.com/customers/heap

Who recently iterated on cstore_fdw to create columnar: https://www.citusdata.com/blog/2021/03/06/citus-10-columnar-...

But I don't think Heap's using columnar

Re:We saved millions in SSD costs by upgrading our filesystem by jhk727 on Tuesday November 09, 2021 @02:37PM (#29166370)
We aren't using cstore_fdw, though we've looked into it in the past. cstore tables don't support deletes or updates, and we still rely on updates for some key parts of our write pipeline. Additionally, we rely heavily on btree partial indexes, while cstore tables only support skip indexes.