What do Data Scientists use to train models fast?

Re:What do Data Scientists use to train models fast? by facorreia on Sunday August 02, 2015 @09:51AM (#9990718)

One approach is to convert the code to use parallelism. For an example of how to do it in Python using joblib see this article: http://blog.dominodatalab.com/simple-parallelization/

Even if you can't afford a 32-core instance, you might get to use 4 cores in your laptop.

[ Parent | on HN ]

Re:What do Data Scientists use to train models fast? by syllogism on Sunday August 02, 2015 @07:15PM (#9992897)

The problem's pretty obviously the Python implementation...Throwing more cores at it isn't really going to help.

Is it even easy to parallelise SVM training?

[ Parent | on HN ]

Re:What do Data Scientists use to train models fast? by moridin007 on Monday August 03, 2015 @01:07AM (#9993925)

so the solution would be move from python to go? like python isn't that good for ML algorithms?

[ Parent | on HN ]

Re:What do Data Scientists use to train models fast? by syllogism on Tuesday August 04, 2015 @12:46PM (#10004531)

Python's fine if the heavy lifting is in a C extension. I use Cython for this; others prefer just numpy, maybe something like numba. But you can't just have a Python list of floats.

Java, C++, Scala and Julia are all popular choices. Go is probably fine too, although I know less about it.

[ Parent | on HN ]

Re:What do Data Scientists use to train models fast? by Lofkin on Friday August 07, 2015 @11:31AM (#10023026)

Actually list support in numba is WIP

[ Parent | on HN ]