Re:Llama.cpp guide – Running LLMs locally on any hardware, f...
by cess11 on Friday November 29, 2024 @02:47PM
(#42276524)
For work I routinely need to do translations of confidential documents. Sending those to some web service in a state that doesn't even have basic data protection guarantees is not an option.
Putting them into a local LLM is rather efficient, however.
Putting them into a local LLM is rather efficient, however.