News for hackers. Stuff that matters.
Re:Weld: Accelerating numpy, scikit and pandas as much as 10... by axegon_ on Saturday September 21, 2019 @02:48PM (#21037144)
I have said multiple times that Rust has an incredible potential in the data analysis world. And Weld is a great example.
Re:Weld: Accelerating numpy, scikit and pandas as much as 10... by the_duke on Saturday September 21, 2019 @04:09PM (#21037638)
Weld is a compiler/JIT/runtime though, something Rust is very well suited for, and which is very different code from data analysis/ML.

I think Julia is a more interesting language for this space, with the built in matrix support, easier prototyping, a REPL, etc...

Re:Weld: Accelerating numpy, scikit and pandas as much as 10... by sppalkia on Saturday September 21, 2019 @05:05PM (#21037927)
Rust is great, but this is an important comment! We used it to implement Weld's compiler and runtime, but we don't expect data scientists who use languages such as Python, Julia, or R to switch over to it; the idea is that these data scientists continue using APIs in these languages, and under the hood, Weld will perform optimizations and compilation for decreasing execution time (and these "under the hood" components are the ones that we wrote in Rust).
Re:Weld: Accelerating numpy, scikit and pandas as much as 10... by fluffything on Sunday September 22, 2019 @05:02AM (#21040374)
Would Weld be able to do a better job if these scientist were using a Rust library instead ?

A lot of people would like to use Rust for data-analysis / machine learning, but there are not really any good batteries-included frameworks for getting started with this.

Re:Weld: Accelerating numpy, scikit and pandas as much as 10... by vmchale on Saturday September 21, 2019 @07:23PM (#21038544)
Lots of languages are well-suited to compilers. See e.g. Haskell accelerate.

I don't really know why you'd use Rust instead of a GC language from the ML family.

Re:Weld: Accelerating numpy, scikit and pandas as much as 10... by janered on Sunday September 22, 2019 @05:54AM (#21040535)
Ahem... ahem..., D?
Re:Weld: Accelerating numpy, scikit and pandas as much as 10... by rolltiide on Saturday September 21, 2019 @03:17PM (#21037302)
If only you could get paid for porting open source libraries, maintaining them and trying to get a community to use it

Have fun entertaining your Patreon

Re:Weld: Accelerating numpy, scikit and pandas as much as 10... by axegon_ on Saturday September 21, 2019 @03:36PM (#21037409)
True that, hence the reason why I do it so little. In fact I personally do it out of pure boredom.