Re:On DataFrame datatype in Ruby (2016)
by MrPowers on Sunday May 30, 2021 @12:24PM
(#27334320)
All programming languages should have a PyArrow-backed DataFrame data structure. After working with DataFrames in Python or Spark, you'll never want to go back to manipulating nested arrays.
Ruby, Go, Scala, Java should all build these libs (Scala has Spark for cluster computing, but it needs a good Pandas-like single node lib) to attract the data engineers. I'd imagine it's relatively easy to add DataFrame support now cause PyArrow does the heavy lifting.
Ruby, Go, Scala, Java should all build these libs (Scala has Spark for cluster computing, but it needs a good Pandas-like single node lib) to attract the data engineers. I'd imagine it's relatively easy to add DataFrame support now cause PyArrow does the heavy lifting.