News for hackers. Stuff that matters.
Re:Running Llama.cpp on AWS Instances by joelthelion on Tuesday November 28, 2023 @06:56AM (#38444798)
Something that would be extremely helpful is a good benchmark of various hardware for llm inference. It's really hard to tell how well a GPU will perform or whether it will be supported at all.

There are no comments on this comment yet.