News for hackers. Stuff that matters.
Re:Release of Fugaku-LLM – a large language model trained on... by Trapais on Monday May 20, 2024 @07:44AM (#40414424)
For comparison, here's 8B [Nemotron](https://huggingface.co/nvidia):

> 1,024 A100s were used for 19 days to train the model.

> NVIDIA models are trained on a diverse set of public and proprietary datasets. This model was trained on a dataset containing 3.8 Trillion tokens of text.

There are no comments on this comment yet.