Re:Supercharged high-resolution ocean simulation with Jax
by moelf on Sunday December 05, 2021 @11:42PM
(#29456240)
I'm not familiar with multi-GPU setup in general. GPU programming in Julia has the advantage that naive operation doesn't even need to be GPU-aware (for writers), since GPU arrays (of any vendor backend) conforms the AbstractArray interface.
If you're advanced library writer, you can leverage: https://juliagpu.github.io/KernelAbstractions.jl/stable/#Wri... which allows you to write kernel, in Julia, that compiles efficiently with rest of native Julia code, and that works cross-vendor!
Back to multi GPU, it seems there's: https://clima.github.io/OceananigansDocumentation/stable/app... which is MPI based?
Re:Supercharged high-resolution ocean simulation with Jax
by adgjlsfhk1 on Sunday December 05, 2021 @11:44PM
(#29456249)
https://www.juliapackages.com/p/pencilarrays is a really good tool to do this type of stuff automatically for some applications.
I've tried to search on my own, but only a way to write CUDA-dependent code: https://juliagpu.gitlab.io/CUDA.jl/usage/multigpu/