Re:HPAT – A compiler-based framework for big data in Python
by zitterbewegung on Friday October 13, 2017 @01:00PM
(#15467394)
From a usability standpoint this is really interesting. If I don't have to think about moving to spark but instead just code within the restrictions of the subset of Python that is really neat.
[ Parent
| on HN ]
Re:HPAT – A compiler-based framework for big data in Python
by tedmiston on Friday October 13, 2017 @01:27PM
(#15467609)
It's especially interesting because of all of the other implications of moving to Spark — like trying to debug your app code that runs PySpark that runs Scala Spark on the JVM. It's very difficult to trace errors all the way through, no way to use tools like pdb. It takes me so much longer to debug errors in Spark code.