News for hackers. Stuff that matters.
Re:Redshift Spectrum – Exabyte-Scale In-Place Queries of S3 ... by awgupta on Thursday April 20, 2017 @11:23AM (#14157483)
it really depends on what you are doing. A large data set shouldn't be limited to longitudinal analysis. If you're storing every log record or every stock bid/ask, there may be times that you need to understand the specifics of what exactly was going on. There may be a lot of filtering on the underlying corpus for these sorts of exact match queries, but data set sizes continue to grow.
Re:Redshift Spectrum – Exabyte-Scale In-Place Queries of S3 ... by awgupta on Thursday April 20, 2017 @11:33AM (#14157569)
that said, I agree that approximate functions should be part of a modern database system. Redshift has approximate count distinct (based on hyperloglog) and approximate percentiles (based on quantile summaries)