Re:MonetDB – Column-store database
by greggyb on Monday June 13, 2016 @10:00PM
(#11899261)
This is interesting to me. What is the indexing strategy that is utilized?
To me the challenge is that the values making up a row are stored non-contiguously. The best case scenario is that a row of N fields requires N data accesses. This is assuming that you can index directly into an array or similar structure with constant access time.
Row-based storage means that you get all fields for "free"when accessing a single row, since the DB engine accesses a page at a time.
This is my understanding of the problem - I am very interested to learn what I'm missing if you have any good articles to share.
Re:MonetDB – Column-store database
by neeleshs on Tuesday June 14, 2016 @03:53AM
(#11900462)
HBase + Phoenix is the closest I know of. Though, the cost of covered indexes is duplication. Phoenix also provides local/global indexes, giving an optimization choice b/w read heavy vs write heavy patterns
To me the challenge is that the values making up a row are stored non-contiguously. The best case scenario is that a row of N fields requires N data accesses. This is assuming that you can index directly into an array or similar structure with constant access time.
Row-based storage means that you get all fields for "free"when accessing a single row, since the DB engine accesses a page at a time.
This is my understanding of the problem - I am very interested to learn what I'm missing if you have any good articles to share.