News for hackers. Stuff that matters.
Re:SparkFun's migration from MariaDB to PostgreSQL by HarrisonFisk on Wednesday November 13, 2013 @12:59AM (#6723629)
Doing compression on the ZFS level is significantly worse than InnoDB compression.

InnoDB has a lot of really smart optimizations which make it much better than just zipping things up. Included are the modification log (so you only have to re-compress occasionally) and a dynamic scaling ability to keep compressed pages in memory rather than always decompressing. These optimizations are really only possible with an understanding of the data.

I would only consider ZFS for something like an append-only data warehouse type system.

Re:SparkFun's migration from MariaDB to PostgreSQL by mtdewcmu on Wednesday November 13, 2013 @09:14AM (#6725237)
I'm sure you would want the compression done by the database and not the filesystem, since there are many ways to do compression to fit specific applications, and the database knows what it's trying to do. I read a little bit of the MySQL docs regarding how it uses compression, and it sounded pretty different than general-purpose compression.
Re:SparkFun's migration from MariaDB to PostgreSQL by rpedela on Wednesday November 13, 2013 @01:14AM (#6723669)
Do you have any references?
Re:SparkFun's migration from MariaDB to PostgreSQL by strlen on Wednesday November 13, 2013 @04:23AM (#6724178)
This is a good intro for those (like me) who are unfamiliar:

https://blogs.oracle.com/mysqlinnodb/entry/innodb_compressio...

I know that a lot of work has been done on InnoDB compression, but I didn't quite grasp the extent, thinking it wasn't far different from Postgres ( http://www.postgresql.org/docs/current/static/storage-toast.... ).