News for hackers. Stuff that matters.

A comment on First Impressions with GPT-4V(ision). Parent comment

Re:First Impressions with GPT-4V(ision) by qingcharles on Wednesday September 27, 2023 @11:06AM (#37675711)
That doesn't seem to make sense. I can run Llama 2 on my 12-year-old desktop PC with no compatible GPU and only 16GB of system RAM. It ain't quick, but it runs.
[ Parent | on HN ]
Re:First Impressions with GPT-4V(ision) by arrowsmith on Wednesday September 27, 2023 @03:48PM (#37680250)
Maybe 700GB is what ChatGPT uses to serve zillions of users concurrently. If you're running your own individual instance, you obviously don't need as many resources.
[ Parent | on HN ]