Re:First Impressions with GPT-4V(ision)
by M4v3R on Wednesday September 27, 2023 @10:21AM
(#37675073)
Where did you get the 700 gigabytes figure from? I don't think OpenAI even released the model size, although it's considered to be 175B parameters. Given how well quantization works at these sizes you would need less than 200 GB of GPU memory to run it.
[ Parent
| on HN ]
There are no comments on this comment yet.