News for hackers. Stuff that matters.
Re:Data Warehouse Benchmark: Redshift, Snowflake, Azure, Pre... by vgt on Monday September 10, 2018 @12:34PM (#17952979)
Great post!

A couple of thoughts:

1. It'd be interesting to see these benchmarks "under real-world adversity". For example, as data is ingested into the DW, as data shapes change, as concurrency of workloads varies.

2. It'd be great to measure "effort" to reach and maintain this performance.

DW vendors are trained on optimizing for static TPC benchmarks with concurrency of 1, which are useful, but can miss the boat on what users actually experience.

(BQ PM)

Re:Data Warehouse Benchmark: Redshift, Snowflake, Azure, Pre... by georgewfraser on Monday September 10, 2018 @12:42PM (#17953049)
We intend to keep iterating on this! If you have a concrete idea, it would be fantastic if you opened an issue or even a PR in our github repo: https://github.com/fivetran/benchmark
Re:Data Warehouse Benchmark: Redshift, Snowflake, Azure, Pre... by massaman_yams on Monday September 10, 2018 @02:37PM (#17953962)
Thanks for the insight! Maybe it was just a brain fart, but I had to look up BQ (BigQuery) just now - the acronym might not be as well-known outside of Google.
Re:Data Warehouse Benchmark: Redshift, Snowflake, Azure, Pre... by vgt on Monday September 10, 2018 @02:43PM (#17954029)
noted :)