News for hackers. Stuff that matters.
Re:Intel Extension for Scikit-Learn by jeffbee on Monday November 01, 2021 @11:09AM (#29067636)
A 5000x boost in KNN inference is not bad.

Generally speaking the distribution-packaged versions of python and all its scientific libraries and their support libraries are best ignored. That stuff should always be rebuilt to suit your actual production hardware, instead of a 2007-era Opteron.

Re:Intel Extension for Scikit-Learn by tomrod on Monday November 01, 2021 @11:28AM (#29067994)
Is there a way via pip/conda to compile these to your environment directly? I see most people just pull from repositories and sometimes see wheel discussed.
Re:Intel Extension for Scikit-Learn by peter_retief on Monday November 01, 2021 @11:33AM (#29068081)
conda install scikit-learn-intelex -c conda-forge
Re:Intel Extension for Scikit-Learn by tomrod on Monday November 01, 2021 @11:36AM (#29068123)
Thanks Peter. I thought conda-forge was a repository/channel, not a command to compile to local environment.

A few followups: (1) Is this usable for non-intelex packages? (2) What about packages not in conda's channels?

Re:Intel Extension for Scikit-Learn by peter_retief on Monday November 01, 2021 @11:38AM (#29068164)
I am busy installing it now. Anaconda should take care of required packages? I am not actually sure. Seems to be working.

Intel(R) Extension for Scikit-learn* enabled (https://github.com/intel/scikit-learn-intelex)

Re:Intel Extension for Scikit-Learn by gojomo on Monday November 01, 2021 @02:49PM (#29071143)
Is there a demo that shows this 5000x speedup?

(A jump that large suggests to me they may be fixing issues in the default implementation that could also be fixed for other processors!)

Re:Intel Extension for Scikit-Learn by blt on Monday November 01, 2021 @02:58PM (#29071289)
Looks like they are responding to https://github.com/intel/scikit-learn-intelex#-acceleration

I completely agree. I hope some Intel competitor funds a scikit-learn developer to read this code and extract all the portable performance improvements.

Re:Intel Extension for Scikit-Learn by napetrov on Friday November 12, 2021 @09:17AM (#29199437)
The point is that sklernex would bring performance for all X86 architectures, not just Intel. And yes scikit developers already working on generic improvements there
Re:Intel Extension for Scikit-Learn by ogrisel on Tuesday November 02, 2021 @04:37AM (#29078545)
As @jjerphan commented above, there is already ongoing effort to get an improved portable brute-force implementation in vanilla scikit-learn, see:

https://news.ycombinator.com/item?id=29069760