News for hackers. Stuff that matters.
Re:Compressing PostgreSQL JSONB data 12x using cstore_fdw by greggyb on Tuesday May 05, 2015 @05:44PM (#9495185)
The biggest bang for your buck with columnstore indexes is for analytical loads. In a data warehousing situation, these are negligible restrictions.

Your use-case is not representative.

Re:Compressing PostgreSQL JSONB data 12x using cstore_fdw by testrun on Tuesday May 05, 2015 @07:52PM (#9495770)
So how do you know what his/her use case is?
Re:Compressing PostgreSQL JSONB data 12x using cstore_fdw by greggyb on Wednesday May 06, 2015 @01:24PM (#9500266)
I don't know what it is, I only know that this comment prompted the deal killer comment:

>>"Note. We currently don't support updating table using DELETE, and UPDATE commands. We also don't support single row inserts.". Just "COPY TO ..." or "INSERT INTO ... SELECT ..." is available it seems.

>So that's a deal killer. Damn.

This limitation is not a dealbreaker at all in a data warehousing environment, as I explained. Thus, I can assume that their use case is not data warehousing.

Re:Compressing PostgreSQL JSONB data 12x using cstore_fdw by azinman2 on Wednesday May 06, 2015 @03:22PM (#9501173)
Correct. I'm not data warehousing. I'm running a parse-like backend out of Postgres, where I have a lot of duplicated json keys. It would be great to have compression on the json to include this, while maintaining the other advantages of the json column store. However as they're hierarchical and there are many of them columns aren't appropriate (as far as I know but I haven't benchmarked some crazy dynamic solution... json certainly is easier to work with).
Re:Compressing PostgreSQL JSONB data 12x using cstore_fdw by greggyb on Wednesday May 06, 2015 @06:06PM (#9502096)
I would keep an eye on the columnstore space. I know that Microsoft introduced read-only columnstore indices before introducing updateable ones, and their turnaround on it was 2 years - SQL Server 2012 to 2014.

I'd use that as the outside end of an estimate for when the Postgres team will get updateable columnstore working.

Re:Compressing PostgreSQL JSONB data 12x using cstore_fdw by ddorian43 on Wednesday May 06, 2015 @08:47PM (#9502722)
Note, updatetable columnstore sucks everywhere, so I don't think so. It's only for OLAP, not OLTP (parse is oltp).

What may help @azinman is group-compression (ex: bigger pages of rows and compress the whole page, where each json-key can be repeated multiple times in a page since each page may have multiple rows). This is what happens on tokudb,hbse,hypertable,cassandra.