News for hackers. Stuff that matters.
Re:Deep neural network written from scratch in Julia by NonEUCitizen on Sunday December 06, 2015 @11:40PM (#10688011)
Can this take advantage of CUDA ?
Re:Deep neural network written from scratch in Julia by olympus on Monday December 07, 2015 @12:00AM (#10688051)
Short answer: No.

Long answer: Looking at the code, this is written in pure Julia and nothing in place for running on a GPU. You could (re)write it but I'm guessing that's not what you meant when you asked.

Look at Mocha.jl if you want a Neural Network implementation in Julia that can run on a GPU: http://devblogs.nvidia.com/parallelforall/mocha-jl-deep-lear...

Re:Deep neural network written from scratch in Julia by etrain on Monday December 07, 2015 @12:40AM (#10688107)
Short answer is actually: maybe!

The bulk of the work done in this code (in terms of FLOPS and, likely, wall-clock time) is going to be in BLAS-3 operations in the feed-forward and back-prop steps. That is, almost all of the work is done using Matrix-Matrix multiplies and in-place arithmetic/transcendental functions.

CUBLAS[1] will allow you to run these types of operations on your GPU at highly accelerated rates, without much more effort than replacing your BLAS library with a new binary. Additionally, if you want finer granularity control over what gets done on the GPU, there are other libraries[2] which provides a direct interface to CUBLAS.

[1] https://developer.nvidia.com/cublas [2] https://github.com/JuliaGPU/CUBLAS.jl