News for hackers. Stuff that matters.

A comment on Haskell running on top of Apache Spark. Parent comment

Re:Haskell running on top of Apache Spark by mboes on Friday February 26, 2016 @04:52AM (#11180646)
Yup, pretty close. Just to be clear though we don't generate any JVM bytecode for any of the Haskell code - we compile that to native code using GHC as per usual but then we dynamically load the resulting shared objects into the JVM.

The static pointer thing is what allows us to share (practically) arbitrary Haskell closures with Scala/Java. And more than that - to get Spark's Scala code to ship these Haskell closures between machines across a cluster.

[ Parent | on HN ]
Re:Haskell running on top of Apache Spark by rkrzr on Friday February 26, 2016 @05:18AM (#11180694)
Ah, thanks for the clarification!

So just for my understanding: the interop with the JVM works via JNI then?

The native code makes calls against the JNI and the Java bytecode calls back into the Haskell native code using the static pointers?

[ Parent | on HN ]
Re:Haskell running on top of Apache Spark by mboes on Friday February 26, 2016 @05:27AM (#11180716)
That's right!
[ Parent | on HN ]