Re:BigQuery vs. Redshift vs. Athena simple benchmark
by gabriel_b on Monday June 19, 2017 @09:40AM
(#14586819)
> of course you can't use a multi-length field delimiter
It is indeed a non conventional format but thats how the source CSV was formatted on https://sdm.lbl.gov/fastbit/data/samples.html
And his problem with the field delimiter really shows lack of experience; of course you can't use a multi-length field delimiter. I've never seen anyone use a comma+space for a delimiter. That file could probably be about 75% of the original file size if he re-created it with just the comma as the field delimiter.
Sorry to bash on the author - don't mean to sound harsh but a lot of people are trying to do benchmarks but with minimal context and whatnot