five minutes! with some silliness groupby("name").agg(the math stuff). So their testbed (coiled, a cluster manager?) is meant to do exactly what the challenge requires. and it was data out of S3.

one thing that i caught there was that parquet serves the same purpose as CSV but for much bigger datasets and now i want to learn more about it.