Re:RWKV.F90: Large Language Model in Fortran
by matteogrella on Wednesday July 19, 2023 @04:22AM
(#36783447)
Hi there,
Just so you know, I'm the one who wrote RWKV.f90. After making a lightweight autograd package that's a lot like PyTorch, but in Go (I called it spaGO), I am now passionately working on adapting the same concepts to the Fortran language.
But first things first, I want to make sure that using your GPU is as easy as pie. That's my next challenge.
https://www.mcs.anl.gov/research/projects/adifor/
Just so you know, I'm the one who wrote RWKV.f90. After making a lightweight autograd package that's a lot like PyTorch, but in Go (I called it spaGO), I am now passionately working on adapting the same concepts to the Fortran language.
But first things first, I want to make sure that using your GPU is as easy as pie. That's my next challenge.
For Nvidia they made the PGI compilers free with the HPC SDK: https://developer.nvidia.com/hpc-sdk