News for hackers. Stuff that matters.
Re:Crate: Distributed SQL Database for the Age of Docker by ddorian43 on Monday April 06, 2015 @04:19PM (#9330487)
Why can't you aggregate on non-indexed fields? I know lucene doesn't allow that, but why? It seems to work on normal-rdbms ?
Re:Crate: Distributed SQL Database for the Age of Docker by jodok on Monday April 06, 2015 @06:13PM (#9330996)
We run aggregations fully distributed and when iterating over the values we heavily rely on the field-caches. They hold the values of the latest used fields in memory and therefor allow in-memory performance on them. for example they don't grow linearly with the amount of rows stored, but depend on the cardinality of the fields. Running aggregations over non-indexed data is not supported.