Re:Running large language models like ChatGPT on a single GPU
by nl on Monday February 20, 2023 @07:48PM
(#34874987)
Yeah this is way wrong, unless counting the salaries of everyone involved for a few years in the lead up while writing software that ended up being used
https://bigscience.huggingface.co/blog/bloom was trained with a $7M grant, and that was the first time they'd done it (so there was a lot of failures).