News for hackers. Stuff that matters.

A comment on Fast.ai and why Python is not the future of ML with Jeremy Howard. Parent comment

Re:Fast.ai and why Python is not the future of ML with Jerem... by amkkma on Thursday September 10, 2020 @12:01AM (#24428768)
Wrong. Julia can call out to Cuda kernels, but it also does codegen for custom ops and types. Technically with enough engineering time, someone could rewrite all those C cuda kernels in julia, and julia would just generate low level machine GPU code on the fly.

Pytorch on the other hand HAS to glue together c and c++ cuda code.

[ Parent | on HN ]
Re:Fast.ai and why Python is not the future of ML with Jerem... by ummonk on Thursday September 10, 2020 @02:21AM (#24429451)
You mean like PyCuda?
[ Parent | on HN ]
Re:Fast.ai and why Python is not the future of ML with Jerem... by dklend122 on Thursday September 10, 2020 @05:09AM (#24430327)
Nope. PyCuda is writing inline C cuda and hardly integrated with python.

Julia has four layers of GPU abstractions, each being successively easier to use ( bit a bit less control. ), all in pure Julia and reusing the compiler and normal Julia abstractions and integrated with AD etc

CUDA.JL, GPUArrays.jl, kernelabstracions.jl, tullio.jl.

At the highest levels you just write normal loops or index notation and the code and backward pass generated. Also generic to backend-simd and multithreading cpu and soon AMD rock, intel accelerator and distributed

This all composed with deep learning libs etc

[ Parent | on HN ]