For the export at GSOC we had a streaming REST interface based on akka-streams. It is used to get the data into other systems based on spark for more complex analysis.

Of course you also lose the compression, but the target system is typically only interested in a small subset of the data.