Re:Open Source AI Is the Path Forward
by fweimer on Tuesday July 23, 2024 @11:52AM
(#41047342)
Don't these public clusters exist today, and have been around for decades at this point, with varying architectures? In the sense that you submit a proposal, it gets approved, and then you get access for your research?
[ Parent
| on HN ]
Re:Open Source AI Is the Path Forward
by JumpCrisscross on Tuesday July 23, 2024 @11:54AM
(#41047389)
Not--to my knowledge--for the GPUs necessary to train cutting-edge LLMs.
All of the major cloud providers offer grants for public research https://www.amazon.science/research-awards https://edu.google.com/intl/ALL_us/programs/credits/research https://www.microsoft.com/en-us/azure-academic-research/
NVIDIA offers discounts https://developer.nvidia.com/education-pricing
eg. for Australia, the National Computing Infrastructure allows researchers to reserve time on:
- 160 nodes each containing four Nvidia V100 GPUs and two 24-core Intel Xeon Scalable 'Cascade Lake' processors.
- 2 nodes of the NVIDIA DGX A100 system, with 8 A100 GPUs per node.
This is the most recent iteration of a national platform. They have tons of GPUs (and CPUs, and flash storage) hooked up as a Kubernetes cluster, available for teaching and research.