Re:Spark vs. Snowflake: The Cloud Data Engineering (ETL) Debate
by ibains on Tuesday July 14, 2020 @06:22PM
(#23838766)
Would love to get perspectives from HN community - did you decide between Snowflake and Spark for data engineering? Which one did you pick, and why?
[ Parent
| on HN ]
Re:Spark vs. Snowflake: The Cloud Data Engineering (ETL) Debate
by sails on Friday July 17, 2020 @01:28PM
(#23873077)
Snowflake through and through.
I haven't used Spark, and have used Snowflake extensively, so I may be quite biased. I imagine Spark has advantages in certain very high performance ML workflows.
(see my HN profile for links to my writing on the topic of Snowflake)
I didn't really understand the blog post to be honest, and I also don't really know how appropriate a direct comparison between Snowflake and Spark is? Perhaps you can give your perspective.