Re:Do we need a third Apache project for columnar data repre...
by jacquesnadeau on Sunday November 05, 2017 @11:36PM
(#15633461)
Arrow supports a union type for heterogeneous columns (we use it for random json in Dremio) and a 128-bit decimal.
Another issue is storing 128-bit decimals. They are more preferable for financial calculations, but are not supported in the Apache projects.
So may be we need a forth standard for columnar data representation. Or expand the existing ones to make them more versatile.
[1] http://easymorph.com/in-memory-engine.html
[2] http://bi-review.blogspot.ca/2015/06/the-world-needs-open-so...