News for hackers. Stuff that matters.
Re:SQL on Distributed GPUs now available on AWS Marketplace by ruw1090 on Wednesday March 29, 2017 @09:46PM (#13992244)
So blazing db mainly uses gpus to speed up compression/decompression? How do gpus help with partitioning and data skipping?
Re:SQL on Distributed GPUs now available on AWS Marketplace by felipe_aramburu on Wednesday March 29, 2017 @10:11PM (#13992328)
BlazingDB uses gpus to speed up transformations, predicates, running predicates on skip data metadata, gpu accelerated join algorithms. In terms of partitioning we use both to generate the data skipping meta data on the partitions and to reorder data around so that we can minimize the number of comparisons joins will likely require or reduce the number of partitions that need to be operated on. At large scale reorganizing information becomes very expensive the gpus allow us to crunch those numbers very quickly.