Re:ChatGPT's 1-Year Anniversary: Are Open-Source Large Langu...
by ekianjo on Friday December 01, 2023 @07:02AM
(#38485816)
a CPU would work fine for the 7B model, and if you have 32GB RAM and a CPU with a lot of core you can run a 13B model as well while it will be quite slow. If you dont care about speed, it's definitely one of the cheapest ways to run LLMs.
[ Parent
| on HN ]
There are no comments on this comment yet.