News for hackers. Stuff that matters.

A comment on LocalAI: Local models on CPU with OpenAI compatible API.

Re:LocalAI: Local models on CPU with OpenAI compatible API by SaaMalik on Thursday April 27, 2023 @09:33AM (#35727869)
Interesting. What are the cpu/memory/storage requirements for running LocalAI?
[ Parent | on HN ]
Re:LocalAI: Local models on CPU with OpenAI compatible API by anton5mith2 on Friday April 28, 2023 @07:01AM (#35739748)
At present, you need a CPU with AVX. For memory I’d say 16GB or so.
[ Parent | on HN ]