Re:How We Built a Vectorized SQL Engine
by manigandham on Monday November 11, 2019 @03:54PM
(#21508814)
> "data needs to be read from disk in its original row-oriented format before processing, which will account for the lion’s share of the query’s execution latency."
IO is still a bottleneck without column-stores. The selectivity, compression and encoding alone can generate massive speedups because there's less data to process, and less to move through the execution pipeline.
But batch/vectorized processing on row-stores is gaining adoption. MemSQL and SQL Server also use similar techniques.
IO is still a bottleneck without column-stores. The selectivity, compression and encoding alone can generate massive speedups because there's less data to process, and less to move through the execution pipeline.
But batch/vectorized processing on row-stores is gaining adoption. MemSQL and SQL Server also use similar techniques.