Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool
by mark_l_watson on Tuesday February 14, 2023 @02:41PM
(#34794813)
They have a link to the bottom for something similar, but with GPT-2. The Hugging Face docs have hints for using FP16, and avoiding double memory requirements for model and checkpoint data.
[ Parent
| on HN ]
There are no comments on this comment yet.