Re:PowerInfer: Fast Large Language Model Serving with a Cons...
by 3abiton on Tuesday December 19, 2023 @06:53PM
(#38703645)
They mention OPT-175B, but the currently only available models are Falcon-40B and Llama2 (up to 70B). Curious about the performance in human chatbot arena LLM leaderboard.
[ Parent
| on HN ]
There are no comments on this comment yet.