Re:Running Llama.cpp on AWS Instances
by joelthelion on Tuesday November 28, 2023 @06:56AM
(#38444798)
Something that would be extremely helpful is a good benchmark of various hardware for llm inference. It's really hard to tell how well a GPU will perform or whether it will be supported at all.
[ Parent
| on HN ]
There are no comments on this comment yet.