SQL Server and Excel PivotTables uses Vertipaq. The main idea is data along columns tend to not change very much. Therefore, one is able to compress data in memory in columns, achieving a very high degree of compression.

Perhaps you can roll something like this as well.